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PREFACE 


' Pared  defense  budgets  a’'e  a particular  challenge 

to  maintaining  supremacy  of  United  States  and  allied 
j forces  against  potential  adversaries.  With  the  quali- 

tative superiority  of  our  tactical  weapon  systems  being 
eroded  by  mushrooming  growth  in  Soviet  military  capa- 
bilities, consideration  of  the  ways  to  employ  military 
li  resources  effectively  in  combat  has  risen  to  a par 

^ with  considerations  of  the  quantity  and  quality  of  the 

p resources.  Supporting  the  commander  in  maximizing  the 

effectiveness  of  combat  capabilities  involves  a full 
; spectrum  of  activity  which  includes  situation  monitor- 

I ing;  formulation  and  evaluation  of  response  options; 

I execution  of  plans;  and  assessment  of  attack,  damage 

! and  residual  capabilities.  With  the  military  comman- 

! der  at  the  conflux  of  this  spectrum  of  activity,  com- 

bat information  and  decision-making  processes  unify 
traditionally  separate  military  functions  such  as 
intelligence,  reconnaissance,  surveillance,  planning, 
control,  attack  and  attack  assessment.  The  decision- 
making process  has  a voracious  appetite  for  informa- 
tion — an  appetite  that  in  culmination  must  be  at 
least  selectively  satiated  toward  sustaining  the 
commander's  ability  to  favorably  terminiate  hostili- 
ties and  active  operations. 

- ’One  of  the  objectives  of  the  workshop  was  to  pro- 
vide the  managers  of  the  Service  Offices  of  Research 
with  the  knowledge  that  will  allow  them  to  formulate 
research  programs  relevant  to  military  problems  in 
decision  infomation.  Included  in  this  objective  is 
the  presentation  of  scientific  disciplines  that  have 
not  previously  been  applied  to  such  military  problems 
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Dut  which  have  high  promise  of  yielding  useful  results. 
Besides  presenting  current  research,  it  is  hoped  that 
the  workshop  will  stimulate  new  research  in  the  scien- 
tific community  both  in  new  areas  and  in  the  applica- 
tion of  current  work  to  military  problems. 

Four  major  objectives  of  the  workshop  have  been 
identified: 

1.  Problem  Identification 

2.  Enhancement  of  Interaction  Between  Researchers 
and  Managers 

3.  Consideration  of  Operational  Effectiveness 
Measures 

4.  Stimulation  of  Relevant  Research 

To  identify  specific  problems  in  decision  infor- 
mation, a number  of  military  officers  from  various 
services  spoke  at  the  workshop.  In  addition,  the 
numerous  military  participants  in  the  workshop  were 
able  to  comment  on  numerous  operational  experiences 
and  problems , as  well  as  discuss  the  application  of 
various  scientific  research  to  these  problems. 

The  problem  of  enhancement  of  interaction  between 
researchers  and  managers  was  addressed  by  numerous 
participants.  The  directors  of  research  for  the  mili- 
tary as  well  as  the  liasons  for  numerous  research 
organizations  contributed  their  first-hand  experiences. 
Others  in  either  the  research  fields  or  the  military 
spoke  to  the  problems  of  interaction  from  their  res- 
pective points  of  view. 

The  consideration  of  operational  effectiveness 
measures  led  to  discussion  not  only  of  benefit-cost 
analysis,  but  also  to  work  in  situation  assessment 
analysis.  Considerable  new  research  of  relevance  to 
this  field  was  presented. 
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The  stimulation  of  relevant  research  was,  of  i 

course,  a pervasive  aspect  of  the  workshop.  This  was 

particularly  stressed  at  the  conclusion  of  the  work-  ' 

shop  when  many  of  the  participants  spoke  directly  to  , 

the  relevance  of  the  presented  research  as  well  as  to 
areas  deserving  additional  work. 

The  first  day  of  the  workshop  consisted  mainly  of  j 

■ presentations  by  military  officers.  After  an  intro-  ! 

I duction  by  Dr.  William  L.  Lehmann  to  the  problem  area,  1 

i ; 

i Major  General  Jasper  A.  Welch  gave  an  overview  of  the  i 

i problems  and  highlighted  areas  of  particular  interest.  ! 

: Rear  Admiral  Donald  D.  Engen  spoke  from  the  Navy's  | 

; viewpoint  and  particularly  stressed  the  role  of  the  j 

JCS.  Lt.  General  W.  L.  Creech  highlighted  many  of  the  j 

particular  problem  areas  both  for  the  military  in  j 

general  and  for  the  Air  Force  in  particular.  Rear  ' 

Admiral  George  E.  R.  Kinnear  then  addressed  some  of  | 

the  problems  of  the  Navy,  including  some  particularly 
relevant  examples . 

Included  in  the  first  day's  presentations  were 
models  of  Dr.  Thomas  Saaty  and  Dr.  James  G.  Miller. 

Both  presentations  evoked  lively  discussion.  These 
were  followed  on  the  second  day  by  the  presentations 
of  the  statistics  panel.  Included  among  these  were 
the  work  of  Dr.  S.  Zacks  on  inventory  scheduling  and 
Dr,  H.  0.  Hartley  on  statistical  PERT  analysis.  Also 
among  the  second  day  presentations  was  such  work  as 
that  of  Dr.  John  A.  Modrick  on  decision  support  and 
Dr.  Clinton  Kelly  on  decisions  analysis.  The  latter 
part  of  the  second  day  was  devoted  to  case  studies, 

including  a very  interesting  paper  by  Col.  T.  Thompson  | 

on  interoperability.  j 


The  last  day  of  the  workshop  began  with  papers  by 
Dr.  Thomas  Saatv  and  Dr.  Clvde  Coombs.  The  livelv 


discussion  that  followed  Dr.  Saaty's  presentation  on 
the  first  day  was  continued.  Also  in  the  last  day  were 
the  presentations  by  the  general  systems  panel,  in- 
cluding Dr.  Robert  Kalaba,  and  the  operations  research 
panel.  The  operations  research  panel  included  discus- 
sion by  Dr.  Seth  Bonder,  Dr.  G.  Bracken,  and  Dr.  J. 
Dockery.  There  was  also  a thought  provoking  discussion 
following  Dr.  M.  Sovereign  concerning  a proposed  cur- 
riculum for  work  in  the  area  of  C^, 

Overall,  certainly  some  of  the  workshop's  objec- 
tives were  met.  The  participation  of  the  military 
both  in  presenting  papers  and  during  the  many  discus- 
sions definitely  contributed  to  the  definition  and 
formulation  of  many  of  the  problem  areas  in  decision 
information.  Similarly,  the  problem  of  enhanced  inter- 
action between  researchers  and  managers  was  approached 
throughout  the  workshop.  The  relevance  of  many  of  the 
areas  of  current  research  was  examined.  In  some  cases, 
this  led  to  new  areas  of  application  and  in  some 
cases  it  suggested  courses  of  future  research,  either 
in  the  form  of  modification  of  existing  work  or  in 
entering  totally  new  areas . The  need  for  future 
meetings  was  pointed  up , both  in  a formal  setting 
such  as  this  workshop  and  in  an  informal  way  among 
the  participants . 
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The  editors  , on  behalf  of  all  the  participants  of 
the  workshop,  would  like  to  express  their  gratitude  to 
the  management  of  Airlie  House,  where  the  workshop  was 
held.  Their  gracious  hospitality  and  lovely  surround- 
ings greatly  increased  the  overall  enjoyment  of  the 
workshop.  We  also  wish  to  express  our  appreciation 
to  Dr.  Ismail  N.  Shimi  who  was  AFOSR  Project  Manager 
for  the  contract  [F44620-76-C-0131]  under  which  this 
workshop  was  funded  and  to  Lt.  Col.  E.  H.  Ramirez, 
also  from  AFOSR,  for  his  handling  of  protocol  matters 
at  the  workshop . 

The  talk  by  Rear  Admiral  Donald  D.  Engen  was  not 
available  for  inclusion  in  these  proceedings.  Also, 
the  remarks  by  Dean  Harvey  M.  Wagner  were  based  in 
part  on  a paper  which  will  appear  in  a commemorative 
volume  to  be  published  as  part  of  the  Office  of  Naval 
Research's  30th  anniversary  activities. 

The  editors  would  also  like  to  make  two  notes 
concerning  the  proceedings.  (1)  We  felt  that  the 
impromptu  discussions  following  the  presentations 
constituted  an  extremely  valuable  part  of  the  conduct 
of  this  workshop.  Therefore,  these  discussions  were 
tape-recorded  and  transcribed.  Due  to  various  techni- 
cal difficulties,  we  acknowledge  that  there  may  be 
errors  in  these  transcriptions.  We  apologize  for  this, 
but  include  the  transcriptions  for  the  considerable 
benefit  they  still  retain.  At  times,  the  discussion 
became  so  animated  that  it  was  difficult  to  identify 
the  speakers.  When  the  identity  of  the  speaker  was 
unclear,  the  statement  is  attributed  to  Question. 

(2)  In  the  interest  of  prompt  publication,  the  papers 
here  have  not  been  refereed  and  aside  from  minor 
changes  appear  here  as  submitted  by  the  authors. 
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The  program  and  attendees  of  the  workshop  are 
given  in  the  appendices  at  the  end  of  the  proceedings . 

The  editors  wish  to  thank  all  of  the  individuals 
who,  in  addition  to  the  speakers,  contributed  to  the 
success  of  the  workshop.  A special  thanks  is  due  to 
the  following  participants  for  their  kind  assistance: 
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Cdr.  F.A.  Austin,  Naval  Operations 

Mr.  J.D.  Baker,  U.S.  Army  Research  Institute 

Dr.  P.  Boggs,  U.S.  Army  Research  Office 

Lt.  Col.  R.A.  Geesey,  U.S.  Air  Force  Systems  Analysis 

Maj . H.G.  Hannah,  Headquarters,  Marine  Corps. 

Dr.  R.L.  Launer,  U.S.  Army  Research  Office 

Lt.Col.  W.Rabe,  Air  Force  Office  of  Scientific  Research 

Dr.  I.N,  Shimi,  Air  Force  Office  of  Scientific  Research 

Mr.  J.R.  Simpson,  Office  of  Naval  Research 

Col.  R.H.  Stuart,  U.S.  Air  Force  Systems  Analysis 

Dr.  R.M.  Thrall,  Robert  M.  Thrall  & Associates 

Dr.  M.A.  Tolcott,  Office  of  Naval  Research 

Dr.  Chris  P.  Tsokos , Robert  M.  Thrall  & Associates 
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WEUXMING  TO  1HE  WORKSHOP 


by  DR.  WILLIAM  L.  LEHMANN 
Vihe-cton,  AFOSR 

I am  happy  to  welcone  you  to  this  workshcp  on  Ccmtand  and 
Control.  It  represents  the  unusual  for  us  in  Defense  research  in 
several  respects.  First,  it  is  unusual  because  it  does  not  becu: 
a familicir  resecuxh  label  such  as  Ihysics,  Chemistry,  Math, 
Mechanical  Engineering,  etc.  Ccttmand  and  Control  is  not  widely 
recognized  as  a reseeurch  field,  but  its  problems  clearly  can  and 
must  be  addressed  by  research.  Second,  it  is  unusual  because  ws 
have  here  today  both  research  professionals  fran  the  gcjvemment, 
academic  and  industrial  world  and  military  professicanals  from  the 
services  who  have  experienced  and  understand  the  real  world  in 
vhich  our  tacrtioal  forces  - land,  sea,  and  air  - most  operate. 
Third,  seme  will  perceive  it  as  unusual  in  that  we  have  three 
services  ceeperating  bo  address  this  prchlem.  But,  if  we  are  to 
meet  the  challenge  of  the  Tfeicrtical  Oemnand  and  Control  problem, 
we  must  depart  from  the  usual  and  acxept  the  unusual,  perhaps  even 
the  radical. 

This  workshop  has  its  genesis  in  a speech  delivered  by 
General  Jasper  Welch  to  the  Aerospace  Sigma  Xi  Club  in  1975.  I 
took  three  ccjnclusions  away  from  that  speech.  These  were: 

(1)  Research  must  tacdcle  the  big  problems  where  a solution 
would  have  a major  inpact  on  the  way  the  Air  Forcje 
operates. 

(2)  Research  must  marshal  or  careate  the  capabilities  and 
disciplines  necressary  to  attach  those  problems.  TOo 
often  research  has  aexapted  only  those  problems  that 
fit  the  existing  organizational  structure  of  the 
established  research  cxranunity. 

(3)  Resecirch  must  understand  the  problem  as  it  exists  in 
fact  and  must  producje  a produch  that  is  recognizable 
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and  useful  to  those  who  must  deal  with  that  real  problem. 

ItJday , one  year  later , we  are  involved  together  in  an 
experimental  workshop.  It  begins  with  statements  of  the  opera- 
tional problems  by  authoritative  representatives  of  the  services. 
Program  managers  frcm  the  services  next  describe  the  current 
development  programs  that  are  addressing  these  prcblans.  Finally, 
members  of  the  academic  and  industrial  research  ccmunities  will 
describe  ongoing  research  they  believe  to  be  applicable  to  the 
stated  operation  prcblems.  We  hope  to  create  new  research  pro- 
grams that  will  let  us  both  understand  and  solve  our  problems. 

We  recognize  that  we  may  fail  in  this  objective  but  failure  to 
try  would  be  inexcusable. 

This  Workshop  is  spaosored  by  the  Joint  OXR's  of  the  three 
services  - the  Offices  of  the  Army,  Navy,  and  Air  Force  tesearch. 
Much  of  the  leadership  and  insight  has  ocme  from  the  Studies  and 
Analysis  communities  of  the  Services.  This  is  a partnership  that 
should  continue  and  should  grow.  It  is  therefore  fitting  that  our 
keynote  speaker  should  be  the  Air  Force's  Assistant  Chief  of  Staff 
for  Studies  and  Analysis,  Major  General  Jasper  A.  Welch.  I am 
proud  to  introduce  General  Welch. 
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SOME  RANDOM  THOUaiTS  ON 
by  MAJOR  GENERAL  JASPER  A.  WELCH,  JR. 

Confusion  Reigns,  But  Help  Is  On  The  Way.  I'm  going  to  talk 
about  a lot  of  diverse  and  unrelated  nutters.  You  may  ask  what 
the  thftiie  is... and  the  thane  is  that  I'm  fairly  confused.  New, 
another  solid  introductory  remark  is  that  mi'  military  colleagues 
addressing  you  later  this  morning  and  afternoon  are  officers  with 
real  operational  experience,  and  they  will  tell  you  about  how 
is  in  the  trenches  and  on  the  battlefields.  I guess  that  the  only 
analogy  to  what  I'm  going  to  talk  about  now  is  the  trenches  of  the 
tentagon.  I'm  going  to  make  a valiant  attenpt  to  describe  those 
Pentagon  trenches,  because  there  are  sane  real  problems  there. 

I'd  also  like  to  say  hello  to  a nunber  of  old  friends  here  - 
including  seme  I didn't  actually  think  to  have  invited  but  got 
here  anyway. . .cind  I'm  delighted  about  that. 

Some  Valuable  Work  Has  Been  Done  So  Far.  My  cwn  particular 
interest  in  the  evaluation  of  an  alternative  information  struc- 
ture started  back  in  the  late  60 's  when  I became  aware  of  a piece 
of  work  done  for  the  Navy.  When  my  staff  researched  it  last  week, 

we  found  out  it  was  sponsored  by  CWRi'^-  by  Dr.  Martin  Talcott, 
who,  I'm  glad  to  say,  is  here.  His  work  covered  the  question  of 

alternate  support  for  an  ASW^'^task  force.  It  was  an  explicit 
simulation  of  the  flow  of  sensor  data  through  a Cembat  Information 
Center.  Then,  scmewAiat  later,  I wound  up  being  involved  in 

the  WWNKXsi^architecture  study.  I remember  particularly  because, 
in  case,  I didn't  knew  anything  about  the  business,  but  I 
liad  become  involved  in  the  war  plan  policy-making  business,  and 
that  impacted  on  the  functions  of  WWMCCS  architecture.  I 

~3 

C - Oormand,  Control,  and  Oomnunication 
1/  ONR  - Office  of  Naval  Research 
2/  ASW  - Antisuhnarine  Warfare 
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learned  a lot  fron  watching  that  activity  over  a period  of  tune. 

(I  understand  we  are  going  to  have  a talk  on  lessons  learned  by 
that  particular  activity.) 

Vfe  tried  to  get  Tan  Belden  here  because  he's  a very  interes- 
ting guy.  Tan  works  in  the  CIA.  Unfortunately  he  could  not  be 
with  us;  but,  just  the  same,  I wouldn't  want  you  not  to  kricw 
about  Tan.  After  he  becane  interested  in  crisis  management,  he 
did  a case  study  of  Pearl  Harbor.  As  you  know,  there  is  a very 
good  unclassified  version  of  that  study  by  Roberta  Wohlstetter 
Anybody  viho's  serious  about  the  function  in  that  particular 
context  really  ought  to  read  her  book. 

Tan  has  done  sane  very  interesting  and  innovative  things  in 
Washington.  One  of  the  most  interesting  things  he  did  is  esta- 
blish a real-time  network  of  secure  catmunications  within  the 
Washington  area  among  the  watch  officers  of  the  various  intelli- 
gence agencies ...  for  the  staggering  price  of  $2.50.  It  was  a job 
everybody  said  coxiLdn't  be  done,  and  we  were  definitely  not 
willing  to  allocate  a reasonable  budget  to  it  simply  because  it 
wasn't  possible.  Tan  thought  about  it  for  a while  and  figured 
out  that  the  problem  was  that  things  were  a little  too  big . . . 
and  that  all  it  took  was  five  toggle  switches. 

I am  also  particularly  pleased  that  we  will  hear  fron 
Colonel  Thoiipson  fron  the  tactical  Air  Forces  Interoperability 
Group.  Their  work  in  describing  a well-known  "monster"  C^  system 
is  especially  interesting. 

"Jet"  Technology  Versus  "Horse  and  Buggy"  Connunication. 

The  current  widespread  interest  in  tactical  C^  arises  fron  a num- 
ber of  ongoing  charges.  We'll  talk  about  several  of  them.  One 
that  I think  is  really  bothersone  to  me  as  a human  being  is  the 
increased  rate  of  application  of  firepower  - the  rate  at  vhich 
firepower  can  be  applied.  A consequerxre  of  this  is  that  the  dis- 
position of  our  forces  and  capabilities  can  change  faster  than  the 
rate  at  vhich  people  are  prone  to  nake  a reevaluation  of  the 
1/  WWMXS  - Worldwide  Military  Cemand  and  Control  System. 
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situation. 


It  takes  nost  of  us  several  hours,  if  not  several  days  - or 
for  the  difficult  situations,  several  weeks  - to  begin  to  get  an 
appreciation  of  the  fact  not  only  of  what  has  changed,  but  even 
that  change  has  taken  place.  With  the  growth  of  modem  munitions 
and  high-speed  delivery  of  weapons  of  all  sorts,  we  beccme 
increasingly  aware  of  a distinct  possibility  that  the  world  can 
change  before  those  in  charge  of  it  can  kixjw  that.  Ihat's  a ftin- 
damental  gap  that  can  really  generate  chaos  - in  the  Biblical 
sense.  (This  is  a far  cry  from  the  war  of  1812,  V\hen  the  war  was 
over  for  a month  before  one  of  the  most  interesting  battles  was 
fought. ) 

Yes,  Politics  Do  Fit  Into  the  Military-C^rations  Picture. 

Another  thing  that  I would  like  to  call  to  your  attention  for 
background  reading  is  an  article  in  the  April  1976  issue  of 
World  Politics  vhich  is  a case  study  of  the  failure  of  national 
intelligence  estimates  in  the  1973  Yon  Kippur  War.— ^ It  has  a 
fair  nutiber  of  lessons  learned.  One  of  which  is  that  in  retro- 
spect (i.e.,  Monday  morning  quarterbacking)  there  were  certainly 
adequate  signals  present.  The  problem  was  that  there  was  a lot 
of  noise  as  well.  There  was  noise  not  only  in  the  external 
cdirnunicaticxis  channels  in  the  case  of  the  Ycm  Kippur  War,  but 
also  within  the  minds  and  hearts  of  the  players  - that  is,  they 
didn't  want  the  war.  Their  predisposition  to  interpret  the  exter- 
nal events  in  terms  of  a predisposed  desire  (a  very  cotmon  inter- 
ference in  thinking)  in  fact  led  to  a very  serious  error  in 
judgment  and  to  the  very  near  tragedy  in  the  events  of  the  world 
at  large. 

This  whole  questicm  of  trying  to  drag  out  the  real  meaning 
of  events  in  the  political  sense  is  with  us  all  the  time.  In 


1/  Avi  Shlaim,  "Failures  in  National  Intelligence  Estimates: 

The  Case  of  the  Yam  Kippur  War,"  World  Politics,  April  1976- 
Princeton  University  Press:  Princeton  NJ. 
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military  operations,  a lot  of  people  try  to  dissociate  and  try  to 
say,  "Ihat's  a different  subject."  I don't  think  it  ^ a diffe- 
rent subject,  because  they  both  involve  the  human  race. 

I think  could  also  learn  a great  deal  from  the  study  of 
crisis  management  (in  nonmilitary  affairs)  vhich  is  very  camon- 
place  - that  is,  the  kind  of  risk-taking  in  our  everyday  lives 
and  the  kind  of  risk-taking  people  do  in  other  cureas  where  they 
feel  a responsibility  for  their  families  and  their  business. 

And  Let's  Not  Forget  Cultural  "Set."  There  also  are  very 
substantial  cultural  problems.  We  have,  for  instance,  engaged  in 
a nuirber  of  pcslitical/military  war  games  where  people  are  faced 
with  artificial  crises  and  asked  to  guess  what  actions  they  might 
take.  You  can  sonetimes  play  two-sided.  One  finds  that  guesses 
have  a very  different  flavor,  depending  on  vhether  the  various 
sides  operate  within  the  cultural  norms  of  the  countries  they 
are  representing.  The  cultural  norms  very  much  color  the  kinds  of 
activities  one  might  want  to  concentrate  on.  Ifestem  nations  by 
and  large,  when  faced  with  a crisis,  try  to  solve  the  prctolem  as 
soon  as  possible.  Other  cultures  want  to  try  for  a long-term 
solution.  They  merely  avoid  the  disaster  of  the  near  term, 
while  permitting  the  flowering  of  sane  favorable  outcome  in  the 
long  term.  So  in  trying  to  establish  what  kind  of  C3  system  you 
want,  it's  important  to  know  what  kinds  of  baokgrounds  the  parti- 
cipators are  coming  from:  that  is,  not  only  their  formal  training, 
but  the  )d.nd  of  world  societies  they  come  fron. 

Enter  "Role  Division."  There  are  a couple  of  other  things 
that  I'd  like  to  talk  about.  I find  it  useful  to  describe  \diat 
the  air  arm  does  in  the  follcwing  three  simple  tas)cs: 

• Deliver  ordnance  on  target. 

• Deliver  perople  and  material. 

• Collect,  process,  and  dissaninate  information. 

The  first  task  has  to  do  with  either  air  or  ground  targets.  The 
second  has  to  do  with  logistics  and  airlift.  The  third  is  more 
pertinent  to  exactly  what  we’re  here  for  - the  process  of 
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gathering  information. 

In  tlie  Air  Force  in  particular,  quite  a bit  of  its  budget 
goes  to  the  selective  processing  of  information  directly  for  the 
Air  Force.  On  the  other  hand  - through  a ccrtiimtion  of  randctn 
events  in  the  past  - a great  deal  of  the  Air  Force  budget  also 
goes  to  support  services  for  other  customers.  Some  of  it  is 
laundered  through  the  Air  Force  budget,  and  we  have  more  or  less 
direct  control  over  it.  A lot  of  Air  Force  people,  even  though 
they're  not  in  the  Air  Force  organization,  are  involved  in  this. 

This  brings  us  to  the  prime  activity  in  the  trenches  of  the 
Pentagon  - to  decide  whether  or  not  that  money  is  being  well 
spent. 

The  classic  delivery- type  missions  (the  first  two)  have  been 
subject  to  a great  deal  of  budgetary  controls,  and  a great  deal 
of  work  has  been  done  on  how  to  tell  vhether  that  type  of  delivery 
systean  is  doing  its  job.  Althou^  there  is  a great  deal  of  con- 
troversy remaining,  there  are  well-developed  disciplines  of 
analysis  and  of  decision  naking,  and  well  established  criteria 
(even  though  there  are  alternate  criteria) . Ihe  controversies 
are  really  a natter  of  choosing  between  several  well-defined 
alternatives . 

Vjhv  Are  Budgets  Up  When  Posts  Per  Bit  Are  Down?  By  contrast, 
in  my  view,  the  question  of  resource  management  in  the  area  is 
almost  out  of  control.  There  are  no  universally  accepted  des- 
criptors or  criteria  suitable  for  use  in  the  budget-decision 
process.  The  increases  in  funding  for  and  information  natters 
continue  to  rise  in  spite  of  the  fact  that  the  costs  per  bit  of 
collecting  and  asserbling  data  have  been  subject  to  enormous 
reductions  in  the  past  10  years.  In  spite  of  the  fact  that  the 
cost  to  perform  a given  operatic*!  has  improved  due  to  an  explo- 
siOTi  in  technological  capabilities  unheralded  in  any  other  tech- 
nology, we're  actually  spending  more. 

You  nay  ratiarber  in  airframe  development  work  vhere  you 
might  get  a factor  of  two  in  productivity  in  a decade.  In  the 
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information-processing  situation,  the  net  cost  per  bit  of 
information  processing  has  gone  down  by  a factor  of  10  in  each 
decade  over  the  last  four  decades.  In  spite  of  that,  we're 
spending  more.  Obviously  we're  trying  to  do  more.  (Vfe're 
certainly  churning  more.) 

It  seems  to  me  that,  from  sheer  horse  sense  and  brute  poli- 
tics, the  dollars  allocated  for  the  process  is  within  a factor 
of  two  of  what  it  is  ever  going  to  be. 

Ihere  are  several  reasons  why  the  current  state  is  the  way 
it  is.  I already  mentioned  the  absence  of  agreed-upon  criteria. 
Another  problem  is  purely  sociological:  That  is,  that  the  hard- 
ware builders  today  operate  against  a separate,  administratively 
controlled  connunity.  Wiat  the  requirement  ccnmunity  says  it 
needs,  the  hardware  builder  is  more  than  happy  to  supply.  That 
interface  occurs  along  a ragged  line  within  the  bureaucracy;  but 
nonetheless  you  can  always  find  it. 

Even  the  requirements  ccnmunity  can  be  reasonable  respon- 
sible as  long  as  they  understand  that  if  they  buy  this,  they 
cannot  have  that.  It  is  my  fiew  that  the  requiranents  ccnmunity 
in  has  not  explicitly  had  direction  in  this  area.  The  reason 
vby  they  are  able  to  simply  respond  to  requests  is  that  for  many 
years  the  costs  amounted  to  a small  fraction  of  the  total 
budget.  The  iimature  technology  of  the  past  produced  self -regu- 
lation. For  example,  there  was  just  so  much  you  could  do  in  the 

way  of  radio  because  there  was  only  so  much  bandwidth;  and 

people  had  long  ago  filled  it  all  up.  So  the  technology  itself 
was  self-regulating.  That's  not  true  anymore.  As  a result,  we 
have  this  great  explosion. 

Breaking  Down  Into  Functions:  For  Clarity.  I have  found 
it  very  useful  to  break  down  functions  in  theater  operations, 
the  following  list  relates  primarily  to  offensive  operations. 

1/  HF  - High  frequency  .\ 
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The  individial  items  range  frcm  large,  aggregated  ones  to  the  more 
specific.  I present  this  because  of  the  confusion  viiien  different 
people  think  about  different  functions,  but  they  call  it  all  C^. 

Sane  people  talk  about  fire  direction.  Fire  direction  is  what 
the  control  theory  people  worry  about,  by  and  large;  that  is,  how 
do  I guide  a guided  missile  to  a target  I have  it  locked-in  on? 
That  in  itself  is  a very  large  and  fairly  well-developed  system 
of  theory. 

Target  development  is  an  Ann/  term  which  you  may  be  fanuliar 
with.  It's  a question  of  looking  out  across  the  landscape  and 
deciding  which  things  are  worth  shooting  artillery  at,  and  finding 
out  vhere  they  are,  and  trying  to  keep  track  of  them. 

We  tend  to  forget  that  the  ICBM  vrorld  has  an  enormous  target- 
development  program  associated  with  it.  Sane  people  know  a lot 
more  about  these  programs  than  others  because  of  certain  intelli- 
gence-caipartmentalization  problems.  But,  in  general,  unless  you 
have  a good  idea  of  what  your  targets  are,  it  doesn't  make  any 
difference  hew  good  your  fire  direction  is. 

There  are  questions  of  allocation  - of  allocation  of  weapxDns 
to  targets  and  of  allocations  of  forces  to  operations.  How  many 
divisions  do  ws  send  into  the  Normandy  landing  and  how  many  do  we 
pull  off  southern  Italy?  How  many  riflemen  to  send  to  the  right 
flank  and  how  nany  to  the  left  flank? 

The  Air  Force  is  very  much  involved  in  the  question  of  allo- 
cation of  forces  to  military  operations,  because  airplanes  can  go 
to  several  different  locations  and  can  do  several  different  things. 
But  they  can  only  fly  one  sortie  at  a time. 

The  allocation  prctolem  has  been  taken  to  great  lengths.  In 
allocation  theory  there  are  very  well-developsed  theories  that  are 
useful.  One  of  them  (which  has  been  around  longer  than  I care  to 
remenber)  is  Lagrange  multipliers.  The  trouble  with  Lagrange 
multipliers  is  that  you  need  to  knew  the  underlying  value  struc- 
ture, and  that  is  what  you  don't  know  when  you're  making  al- 
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locations  to  operations  - because  operations  have  a time  dimen- 
sion, and  an  interactive  dimension. 

In  Military  Operations,  the  Exploitation  Phase  Is  Just  As 
Important  As  the  Set-Up  and  Strike  Phases.  In  dealing  with 
military  operations,  I like  the  book  by  Liddel  Hart  called 

Strategy.—'^  He  is  one  of  the  world's  leading  military  historians. 
In  the  back  of  that  book  is  a striking  insight  about  military 
operations.  In  his  view  there  are  three  phases:  the  set-up 
phase,  the  strike  phase,  and  the  exploitation  phase.  Hart,  quite 
rightfully  in  my  view,  conplains  that  most  people  only  worry  about 
the  strike  phase.  That's  the  easy  pert.  The  hard  pert  is  the 
set-up,  to  maneuver  so  that  the  opponent  is  off  balance  or  overly 

deperxlent,  so  that  the  strike  makes  a difference.  And  then 

there's  the  qiostion  of  exploitation. 

Sane  exploitations  are  really  rather  ctovious.  If  you  make 
an  artillery  bonbardment  on  the  right  flank,  you  ought  to  send 
your  armored  forces  out  more  or  less  to  the  right  flank  to  take 
advantage  of  the  bonbardment  you  did  there.  Nonetheless,  in 
this  year  of  the  Bicentennial,  it  is  well  to  remember  that  one  of 
the  reasons  George  Washington  was  so  successful  is  that  in  the 
campaigns  around  New  York  City,  the  British  General,  William  Howe, 
failed  to  exploit  his  initial  victory  each  and  every  time.  As  a 
result  of  which,  we  had  a Bicentennial  this  year.  That  was  a 
classic  case  of  failure  to  exploit  a successful  strike  phase. 

Maneuver  Can  Also  Be  the  "Message."  To  seme  extent,  many 
times  in  the  past,  failure  to  exploit  success  came  about  because 
the  guy  didn't  knew  he  had  any  success  to  exploit.  The  whole 
question  of  whether  maneuver  is  more  important  than  firepower, 
and  vice  versa,  has  filled  the  military  history  books.  Madem 
C^  will  add  complexity  to  the  debate. 

Before  the  age  of  the  sensors  and  ccrmunication  we  now  think 

V Liddell  Hart,  Basil  Henry,  Strategy  (New  York,  Praeger,  1967) . 
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about,  the  only  way  to  find  out  if  there  was  a unit  on  the  other 
side  of  the  hill  was  to  go  over  and  see  if  anybody  shot  at  you. 

If  you  didn't  send  a reasonable  enough  force,  you  still  didn't 
find  out  because  nobody  cane  back  - and  you  didn't  know  if 
everybody  had  gotten  lost,  had  deserted,  or  had  gotten  shot.  So, 
maneuver  itself  was  an  instnnent  of  canbat  information. 

Ihe  lack  of  detailed  information  at  a distance  in  those 
days  led  to  a lot  of  other  fundairental  battlefield  phencmena.  For 
instance,  units  began  to  feel  encircled  when  they  really  weren't. 
Ihe  classic  case  of  that  is  in  Barbarosa  where  in  the  ' 42  campaign 
of  the  Germans  against  the  Russians,  there  was  a pincer  movarent 
in  the  vicinity  of  Minsk.  The  Soviet  army  of  300,000  people  sur- 
rendered virtually  without  being  shot  at  or  having  shot  in  anger 
themselves,  because  they  perceived  thanselves  to  be  surrounded 
with  a double  pincer  involvanent  by  the  Germans.  The  reason 
they  perceived  they  were  enveloped  was  that  they  received  tele- 
graphic messages  vhich  said  that  all  the  cities  and  villages 
around  them  had  "fallen"  to  the  Germans.  I suspect  - unproven  - 
that  what  had  happened  in  a number  of  instances  was  that  a lost 
German  squad  had  wandered  through  and  their  vehicle  had  broken 
dcwn.  They  couldn't  go  any  fiirther  and  didn't  want  to  spend  the 
night  out  in  the  fields,  so  they  camandeered  the  local  village 
chief's  headquarters  and  sent  a telegram. 

Mast  Of  Us  Can  Recognize  A Reubens  Much  Better  Than  We  Can 


Paint  One.  The  facts  are  that  the  Russian  amy  could  have  inarched 
out  of  their  positions  in  any  arbitrary  direction  and  they  would 
have  been  lucky  even  to  find  a German,  the  Germans  were  so  thinly 
spread  in  this  envelopment.  But  they  didn't  do  that,  they  sur- 
rendered. There  was  a case  where  the  maneuver  on  the  part  of  the 
Germans  had  an  effect  far  out  of  proportion  to  its  actual  mili- 
tary possibilities. 

To  back  that  up  again  - all  this  has  to  do  with  "vdiat  is  the 
situation?"  (that  is,  situation  assessment,  relating  again  to  the 
warning  aind  indication  system)  and  finally  to  the  question  we've 


gotten  very  much  involved  in,  the  question  of  preplanning. 

Military  operations  are  ccmplicated;  and,  to  a large  extent, 
you  can  only  hope  to  do  those  things  in  war  ^^ilid^  you  can  practice 
in  peace.  You  try  very  hard  to  practice  building  block- type 
operations  which  can  be  used  to  apply  to  the  actual  circumstances. 
Nonetheless,  to  the  extent  you  have  preplanned,  to  the  extent 
that  you  know  vhat  you're  looking  for,  you  can  get  a tremendous 
amount  more  out  of  your  information  system  because  you're  in  the 
business  of  correlating  it,  not  just  trying  to  paint  a picture 
out  of  the  \diole  situation.  Let's  face  it  - most  of  us  are  a lot 
better  at  recognizing  a Retiiens  than  are  at  painting  one. 

What  the  Ccmputer  Can  Do,  the  Human  Mind  Can  Sometimes  Do 
Better.  Ihis  whole  notion  about  thinking  thitsugh  what  it  is 
you're  looking  for,  and  what  you  can  do  about  it,  is  rather 
intriguing.  It's  the  connection  between  how  people  think  in 
their  minds  and  how  their  conbat  information  systems  work  in 
battle.  Ihose  processes,  in  ity  estimation,  are  completely  er.- 
twined  one  with  the  other. 

Ihere  are  many  people  today  who  have  done  completely  the 
wrong  thing  in  a nuntoer  of  combat  information  systems  - that  is, 
they  give  given  to  automatic  data  processing  those  things  that 
the  mind  does  best,  and  vice  versa.  The  organization  of  geome- 
trically related  information  is,  generally,  quite  easy  for  the 
hunan  mind.  It  may  be  rather  easier  for  some  than  for  others, 
but  there  are  quite  well-developed  psychological  tests  to  sort 
those  people  out.  And  there  are  other  things  the  human  mind  can 
do  better. 

There  are  seme  simple  things  that  I see  people  not  keeping 
straight.  On  the  question  of  vdiether  a piece  of  information  is 
worthwhile  or  not,  there  are  a nunber  of  tests  in  this  context 
which  things  ought  to  meet.  You'd  be  surprised  how  mny  dumb 
ideas  get  sorted  out  because  they  don't  meet  very  elementary 
tests. 
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Give  the  Information  the  "Worthwhile"  Test?  The  first  and 
foransBt  test  a piece  of  ccrbat  information  should  meet  is: 

"Does  it  resolve  a real  ambiguity?"  We  ask  not  only  is  it  infor- 
naticai  in  the  Shannon  sense  of  resolving  an  ambiguity,  but  hew  big 
an  ambiguity?  You  say  the  missile  was  successfully  launched. 

Could  it  have  been  either  way?  Not  really,  because  one  has  a 
tremendcus  amount  of  a priori  information  about  the  ensemble  of 
all  missiles;  and,  whether  or  not  that  particular  missile  was 
launched  may  or  nay  not  be  an  ambiguity  worth  resolving.  If  most 
of  them  go,  then  it  turns  out  you  really  can't  improve  matters 
much  by  knowing  which  one  didn't 

Second,  there  is  always  a best  thing  to  do  if  the  ambiguity 
is  unresolved.  Ihe  question  is:  "Is  the  best  thing  to  do  that  much 
better  an  outoone  if  you  have  resolved  the  amgiguity?"  Can  you  do 
anything  different  - not  even  better,  just  different  - after 
having  resolved  the  ambiguity?  That  is  worth  checking. 

In  nany  cases,  you  can't  do  anything  different.  But  the 
gry  says,  "Well,  it  will  make  the  ccirmander  feel  better."  A 
lot  of  stuff  is  justified  on  the  basis  that  it  will  make  the 
camander  feel  better.  So,  is  there  even  an  alternative  action? 
Does  that  alternative  action  result  in  a different  effectiveness? 

Is  there  an  alternative  outcone?  Is  it  a higher-order  outcome? 

Now  eventually,  getting  beyond  that,  you  worry  about  action/ 
reaction  and  trying  to  see  if  there  is  anything  acceptable. 

Because  after  all,  ccrbat  is  an  interactive  situation. 

Don't  be  dismayed  because  these  fifth,  sixth,  sind  seventh 
levels  are  very  difficult  to  carry  out.  You  can  generally  threw 
out  the  cbviously  bad  ideas  way  back  at  the  first  or  second  levels. 
But  those  levels  are  not  systematically  applied,  and  they  are  not 
systematically  taught  to  managers. 

Decisions,  Decisions:  Do  I Act  New,  Or  Do  I Use  Up  Precious 
Time  To  Get  More  Information?  Lest  you  figure  that  offense  is 
everything,  there  are  seme  other  activities  related  to  defensive 
operations  and  support  operations  that  I haven't  thought  through 
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so  carefully.  The  first  one  I very  much  want  to  bring  to  your 
attentiai  is  the  question  of  can  you  do  anything  on  the  basis  of 
the  information?  ttie  of  the  most  inportant  things  for  a coimand 
center  to  do  is  to  decide  whether  or  not  to  request  certain  other 
information.  There  is  an  ofportunity  cost  in  the  time  required 
to  acquire  this  other  information;  and  this  is  often  used  as  a 
cop-out.  There  are  numerous  exanples  of  people  going  down  the 
tubes  while  waiting  to  find  out  what  the  situation  really  is. 

The  question  of  asking  for  information  to  be  collected  is  very 
inportant. 

Guard  Against  Your  Opponents'  Smokescreens.  Information- 
collection  is  particularly  important  to  the  Western  Allies  be- 
cause our  opponents  have  a policy  of  cover,  deception,  and  dis- 
information. That  is  considered  equal  in  their  minds  as  an  arm 
of  varfare  to  tanks,  guns,  ships,  and  planes.  To  the  extent  to 
which  you  build  yourself  a combat  information  system  and  to  the 
extent  that  you  rely  on  it  to  improve  the  efficiency  and  effec- 
tiveness of  your  forces,  you  open  up  a flank. 

That's  alvays  the  sutuation  in  the  military — that  no  matter 
what  you  do  directly,  you  always  open  up  a flank  indirectly.  The 
indirect  flank  that  goes  with  betting  on  a combat  information 
system  is:  opening  yourself  up  to  disinformation,  cover,  and 
deception — as  well  as  interference  in  cutting  the  channels.  So 
it's  very  important  to  recognize  that  and  to  ctrrange  to  be  able 
to  confirm  the  information's  validity  and  decide  vhat  you're 
going  to  do  about  it. 

You  Don't  Have  To  Disseminate  the  Informaticxi  Just  Because 
You've  Got  It.  There's  a bad  set  of  words  with  regard  to  dis- 
semination and  filtering  of  data~as  if  that's  all  you  do  with  it. 
It's  a "quick"  system — to  disseminate  data  irplies  that  the  guy 
v«ho  has  it  gives  it  to  someone  else.  I don't  know  how  you  dgr-ide 
when  the  "push"  data  and  vdien  to  "pull"  it — when  you  should  order 
data  and  vhen  you  should  disseminate  it.  It's  a very  conplicated 
business;  hut,  at  a minimum,  you  ought  to  understand  that  there 


are  t±»ose  two  choices.  Just  because  you  have  a bit  of  data 
doesn't  mean  you  have  to  go  tell  everybody  about  it.  Every  time 
you  do  it,  it  costs  mcney — and  that's  an  opportunity  cost.  It 
may  be  useful  just  to  have  it;  and  if  anyone  wants  it,  that's 
fine. 

You  might  say,  "That's  silly.  I've  gcsie  to  great  expense 
to  collect  it  and  vrfiat  good  is  is  to  have  it  sit  around  in  any 
cxxrputer  bank?"  One  of  the  reasons  is  that  it  may  be  cheaper  for 
the  other  guy  to  collect  it  himself  rather  than  to  ask  you,  or 
for  you  to  send  it  to  him.  That’s  one  of  the  great  nyths  in  this 
business:  if  I've  got  it  in  one  of  ny  ccnputers  £md  I want  to 
get  it  into  another  cne,  it's  always  cheaper  to  transfer  it  be- 
tveen  ccnputers.  I see  no  evidence  that  that  is  the  case.  On 
the  ccntrary,  there  are  many  cases  where  it's  a lot  che^«r  just 
to  recollect  the  data  frcn  scratch.  You  know  that's  true.  For 
exanple,  ycu  let  each  rifleman  aim  at  the  target  even  though  OTie 
guy  knows  where  the  target  is,  and  he  could  tell  all  the  others 
hew  to  aim  their  rifles. 

Is  It  a Black  Zebra  With  t^hite  Stripes  Or  a White  Zebra 
With  Black  Stripes?  What  people  want  to  know  about  is  the  ques- 
tion of  resolving  an  ambiguity  related  to  their  plans  or  to  their 
anxieties.  The  first  thing  they  want  to  know  is:  "Am  I on  track? 
Are  things  more  or  less  right?"  They  want  very  stall  pieces  and 
amounts  of  data  which  are  the  aggregations  and  the  integrals  and 
correlation  functions  over  a lot  of  things.  For  a single  set  of 
data,  different  people  want  different  correlation  functions, 
different  integrals. 

The  flow  of  great  quantities  of  data  serves  a very  useful 
purpose  when  you  want  to  have,  for  exanple,  two  correlators 
looking  at  the  same  piece  of  data  and  cctrparing  their  perceptions. 
There  is  a case  where  they  want  the  same  data  set  available, 
physiccdly,  to  two  different  correlators.  They  both  know  that 
their  correlators  are  inperfect,  and  they  want  to  corpare  the 
outputs,  given  the  same  inputs.  "Da  you  see  what  I see?"  One 
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says,  "I  see  a white  zebra  with  black  stripes;"  and  the  other 
says,  "I  see  a black  zebra  with  \Ahite  stripes;"  and  the  ccmander 
says,  "You  SOBs  shoot  him  anyway!" 

CCmbat  Informaticn  Systems;  Shadow  Or  Substance?  One  of 
jobs  is  to  proffer  advice  on  whether  or  not  one  should  spend 
money  on  a particular  piece  of  hardware,  be  it  airplanes  or 
missiles  or  munitions.  Occasionally,  we  get  asked  to  do  that 
about  canbat  information  systans.  We  don't  do  a very  good  job 
of  answering  that.  A year  ago,  vhen  I came  to  Studies  and 
H Analysis,  V we  set  out  to  collect  several  good  pec^jle  and  gave 

;;  them  the  job  of  getting  better  at  that.  They  seaned  to  be  doing 

pretty  well. 

However,  suddenly,  a few  months  ago,  I had  a terrible, 
terrible  thought.  That  thought  was  that  sooner  or  later,  those 
guys  were  going  to  cate  up  with  a method — and  I would  be  faced 
with  the  decision  as  to  whether  that  output  was  valid  enough  to 
allow  it  to  be  entered  into  the  real  decision  process.  What 
tests  could  I apply?  If  the  questiat  were  the  value  of  an  IR 
sensor,  I would  iimediately  know  to  ask  about  transfer  functions 
and  interference  fron  outside  forces  and  a whole  list  of  things. 
But  I don't  know  how  to  test  a thing  which  alleges  to  evaluate  a 
combat  informaticn  system.  Let  me  tell  you  how  far  along  I am 
and  the  tests  I am  aj^lying.  It  may  occur  to  you  that  there  are 
some  other  questions  I should  ask. 

What  Should  a "C^  Simulaticxi"  Be  Able  It)  Do?  What  we're 
going  to  have  is  a simulation  of  a ocmbat  informatirai  system. 

Here  are  the  things  that  I think  the  simulation  ought  to  be  able 
to  do: 

First,  it  ought  to  be  able  to  discern  the  range  of  logical 
i future  acticais  of  the  opposing  force  to  carry  out  those  actions. 

Can  he  encircle  the  left  flank  and  is  he  likely  to  want  to  do  so, 

■ 1/  Assistant  Chief  of  Staff,  Studies  and  Analysis,  HQ  USAF 

(AF/SA) . 


17 


r 


TP 


i 

I 

given  ray  current  situation? 

Second,  the  simulation  should  be  able  to  plan  the  actions  of  j 

the  friendly  forces  such  that  if  they  were  carried  out,  the  in-  j 

herent  capabilities  of  the  friendly  forces  would  cane  into  play.  | 

If  I have  a bcinber,  it  ou^t  to  be  able  to  plan  a bonbing  raid  ! 

) 

in  a way  that  utilizes  the  bcitber's  inherent  capability.  j 

Third,  can  the  sirrulaticn  control  the  ooirbat  intensity — the  j 

rates  of  engagement — in  accordance  with  planned  rates  or  inten- 
sities? One  of  the  troubles  with  a lot  of  simulations  is  that 
they  assime  both  forces  go  at  it  like  two  scorpions  in  a bottle, 
trying  to  maximize  engagement  rates.  Rarely  is  that  the  objective 
in  ccribat  operations.  The  more  general  statement  is  that  you  plan 
on  a rate  of  engagement  and  try  to  keep  your  forces  on  that  plan. 

TWO  other  points  are:  fourth,  the  ability  to  control  the 
moveirait  and  alert  status  of  frioidly  forces  in  accordance  with  a 
plan  or  agreed-upon  reaction,  and  fifth,  the  ability  to  function 
better  if  provided  with  more  basic  information  or  better  or  higher 
quality  infornaticn  or  more  timely  infontaticn.  You  don't  know 
how  much  more,  but  you  feel  that  if  you  increase  the  information 
and  the  simulation  does  itore  poorly,  there  is  sate  structural 
defect. 

Anotyer  text  is,  sixth,  the  ability  to  manage  the  probecticai  < 

and  delivery  of  supplies  and  maintenance  to  maintain  the  inherent 
capabilities  of  friendly  forces. 

Then  I thought  of  one  test  that  may  be  very  controversial. 

That  is,  seventh,  the  ability  to  aoccrmodate  and  condensate  for 
unexpected  or  unfortunate  events,  erroneous  or  missing  data,  or 
aberrant  actions  of  subordinate  or  siderordinate  headquarters. 

You  really  wouldn't  want  to  have  a military  operation  where  one 

bad  decision  could  picpagate  and  infect  the  whole  organizaticxv.  i 

Most  military  arrangements  have  vrays  to  keep  that  from  happen- 
ing...one  of  which  is  bo  fire  the  cormander. 

The  finsil  points  are:  eighth,  the  ability  to  exploit  oppor- 
tunities afforded  hy  actions  or  characteristics  of  the  enemy 
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forces  and,  ninth,  the  ability  to  achieve  a prxDper  balance  of 
contributirais  to  the  overall  anong  the  headquarters  appropriate 
to  their  status.  For  exaiiple,  it  was  alleged  in  one  simulation 
that  there  was  input  fran  Corps  headquarters,  but  if  you  put  in 
random  nunabers  for  the  input  fron  Corps  headquarters,  there  was 
no  change  in  the  canbat.  That,  I would  think,  would  be  an  in- 
appropriate balance. 

Sumning  Up.  I can  only  sun  up  such  a random  assortment  of 
thoughts  by  sharing  ny  overall  motivation — that  this  assanblage 
of  talented  individuals  from  so  irany  diverse  fields  can,  over 
the  next  three  days,  provide  a broader  and  deeper  insight  to  each 
of  us.  I know,  speaking  as  both  a researcher  and  a government 
executive,  that  the  hardware  technology  provides  us  greater 
premise  than  it  has  rewards— and  i iope  that  semehow,  working 
together,  we  can  reverse  that  judgnent. 
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DISCUSSION 

Bonder:  Why  do  you  have  to  do  better  with  more  information? 
Welch:  Because  more  information  costs  money  and  my  job  is  to 
decide  whether  it's  worth  buying  the  information. 

Bonder:  Why  does  the  real  world  do  better  with  more  information? 
Why  does  the  process  behave  better?  In  the  real  world,  if  you 
watch  cotmanders  making  decisions,  you  will  see  that  vrtien  more 
than  a certain  amount  of  information  comes  in,  they  don't  use 
it.  They  just  discard  it. 

Welch:  I think  that's  true.  It  happens  all  the  time.  I'm  torn 
because  there  are  two  things.  I set  that  criterion  up  as  a test 
for  whether  the  simulation  was  rational  or  not.  I did  not  want 
it  to  be  the  result  of  a structural  defect  of  the  model.  Our 
current  thought  on  how  this  effect  occurs  is  built  on  this  idea 
of  correlation  integrals.  That  is,  one  is  providing  more 
exanples  of  the  same  wrong  correlation  integral  at  either  too 
low  an  aggregation  or  too  high  an  aggregation.  Most  of  our 
thought  processes  now  revolve  around  the  question  of  what  are 
reasonable  correlation  integrals  for  each  headquarters.  I think 
that,  depending  on  the  action  you  take,  there  are  different  kinds 
of  correlation  integrals. 

Dockery:  Ycu  had  a rather  interesting  list  of  things  with  regard 
to  simulation.  Do  you  want  the  simulation  to  do  these  things 
while  it  is  running  or  do  you  want  it  to  play  out  the  battle  so 
saneone  can  cane  along  later  and  draw  his  own  inferences. 

Welch:  I started  the  list  for  a very  simple  thirq.  When  people 
brought  me  their  test  cases,  I wanted  to  see  if  the  simulation 
was  even  capable  of  doing  those  fundamentals.  I had  the  notion 
that  if  it  was  incapable  of  doing  that,  it  probably  wasn't  a 
rich  enough  a.nd  responsive  enough  simulation  that  I would  be 
willing  to  say,  "The  simulation  says  that  system  A is  better 
than  system  B".  Clearly,  this  list  can  be  used  for  different 
types  of  analyses.  The  answer  to  yDur  question  is  a little  bit 
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of  both. 

Henderson:  I think  you  might  want  to  check  into  a study  I heard 
about  a year  ago  in  which  people  tried  to  do  a simulation 
using  people  with  operational  experience  as  division  caimanders. 
The  result  was  that  frcm  comander  to  comander  the  outcomes 
and  decisions  were  very  different. 

Welch:  I think  that's  a very  exciting  piece  of  information.  It 
is  our  plan  to  allow-encourage  statistical  variation  in  decisions 
Let  me  add  to  it  the  other  csctrane.  Six  years  ago  I saw  a 
historical  survey  of  armored  engagements  in  the  twentieth 
century.  They  plotted  which  side  won  as  a function  of  force 
ratio  . They  found  that  indeed  there  was  a correlation  but  it 
was  very,  very  low.  Even  with  a 3 to  1 advantage,  there  was 
sane  propensity  to  lose.  By  no  means  was  it  a high  correlation 
between  winning  and  force  ratio.  The  lesson  I drew  was  that 
better  decisions  or  luck  or  terrain  was  a very  important  factor 
in  the  outcone.  I think  there  is  a mythclogical  hope  that  part 
of  the  noise  they  saw  was  noise  that  could  be  corrected  by 
better  conbat  infomation.  This  is  a couterexample. 

Knight : I wrould  like  to  make  a few  observations  because  you  hit 
on  intelligence  in  your  talk.  I think  we  should  consider  the 
role  of  intelligence  here.  It  is  obvious  that  intelligence  plays 
a very  important  part  in  ccrmand  and  control  systems.  Without 
intelligence  you  don't  know  how  to  conmand  and  control  your 
forces  and  you  can't  make  optimal  allocations.  We  have  to  make 
a distinction  between  information  6ind  intelligence.  Information 
is  unevaluated  data  which  can  produce  intellience.  Intelligence 
is  predictive  in  nature.  It  evaluates  what  comes  in,  helps  value 
that  information.  The  primary  function  of  the  intelligence  offi- 
cer is  to  provide  not  only  the  information,  but  also  the  con- 
clusions based  on  the  information.  There  is  a tradeoff  between 
different  kinds  of  information.  Sane  information  is  of  iimvediate 
value  and  must  be  ccrmunicated  to  the  catitander  directly.  The 
role  the  intelligence  officer  plays  in  this  is  to  provide  pre- 
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diction  and  fill  in  the  gaps.  To  put  this  in  perspective,  I 
refer  to  the  words  of  Gen.  Bradley.  "My  intelligence  officer 
tells  re  what  I should  do.  My  logistics  officer  tells  re  what  I 
can  do.  I decide  what  I will  do." 

Welch:  I did  not  use  information  in  the  way  you  referred  to 
there.  That  is  a classic  and  important  distinction  you  made. 

But  today  because  of  the  way  bureaucracy  has  grcwn  up,  the 
classic  intelligence  ccnnunity  is  in  a very  awkward  position. 
There  are  large  sources  of  both  evaluated  and  unevaluated  infor- 
mation over  which  the  intelligence  organization  has  no  control. 
There  are  a large  number  of  evaluative  and  action-taking 
organizations  over  which  the  ccrmander  has  no  control.  Many 
of  these  are  of  the  nature  of  an  autonatic  guidauice  systan.  In. 
many  cases,  in  particular  in  aircraft  operations,  the  catmander 
is  involved  down  to  the  pilot  or  a forward  air  controller  who 
assumes  control  of  a few  airplanes  for  short  tire.  I have  used 
the  word  "Information"  here  to  describe  the  totality  of  bits 
of  data  flowing  about,  whatever  may  be  their  bureaucratic  origin 
and  whatever  may  be  the  orgcuiizational  entity  that  collects, 
processes  and  acts  upon  it.  It's  one  of  the  features  of  the 
year  1976  that  many  of  these  departments  are  caning  out  of  the 
woodwork  and  a lot  of  us  are  involved  in  trying  to  glue  to- 
gether what  has  become  a very  splintered  currangetnent . That's 
an  extra  added  burden  on  the  current  situation.  That's  a very 
serious  problem.  There  are  many  serious  men  fighting  it  and 
there  are  nany  lobbyists  involved  in  it. 
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REMARKS  Cr  THE  WORKSHOP 

by  LT.  GENERAL  W.  L.  CREECH 
Hanicom  KL\  Voice.  Base 

It  is  inportant  to  assess  our  current  situation  with  regard 
to  Tactical  C^.  We  need  to  see  vdiat  we  are  doing  right  and  vdiat 
we  need  to  ijiprove.  First,  we  need  a ccmrDn  frarte  of  reference 
for  Decision  Informatior,  and  Tactical  Gamand,  control  and  ccm- 
munications.  There  are  four  fundaitental  questions  that  describe 
an  engagement: 

1.  With  vdian  will  we  fight? 

2.  Where  will  we  fight? 

3.  On  what  scale  will  we  fight? 

4.  On  vihat  timetable  will  ws  fight? 

The  development  of  an  appropriate  investment  strategy  is  not 
an  easy  task.  The  influence  of  Congress  makes  a long  range  stra- 
tegy difficult  to  maintain.  The  limitations  of  money  lead  to 
certain  tradeoffs.  One  tradeoff  is  that  of  quality  versus  quan- 
tity. Anothear  is  that  of  one  program  over  another. 

I believe  that  we  are  generally  doing  a good  job  currently. 
Nonetheless,  it  is  instructive  to  consider  our  liabilities. 

First  ve  should  consider  sane  of  the  possible  situations  that 
could  arise.  We  can  handle  any  situation  in  the  third  world  ex- 
cept perhaps  PRC.  Another  possibility  is  a conventional  war  with 
the  USSR  in  central  Europe.  There  are  other  areas  vhere  it  is 
unclear  vhether  we  would  fight  and  on  what  scale.  One  would  pro- 
bably fight  to  defend  the  oil  fields  of  the  Middle  East  and  Japan, 
and  less  likely,  to  defend  India,  Korea  or  Formosa. 

There  are  several  generalizaticris  that  we  must  consider. 

The  USSR  has  the  advantage  of  knowing  where  they  will  fi^t. 

They  probably  woiHd  fight  in  central  Europe  but  not  in  Chile. 

There  are  sane  areas  where  the  U.S.  must  rely  on  nuclear  weapons, 
both  tactical  and  strategic.  All  these  oorplexities  must  be 
considered  in  planning  tactical  C^.  We  must  not  rely  co  abstrac- 
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tions.  We  now  examine  sone  of  t±ie  areas  that  may  require  adjust- 
ments in  our  investment  strategy. 

One  such  area  is  central  Europe.  A major  prctolem  is  insuf-  ' 

ficient  ccnmunication.  Ttiis  cotinunication  must  be  in  both  direc-  i 

tions,  up  as  well  as  down  the  line  of  ccritiand.  The  problem  lies 

in  the  basic  infrastructure  in  the  locations  where  we  are  most  '■ 

litely  to  fight.  This  difficulty  supercedes  even  the  problem  of  ' 

v^t  to  oonmunicate . One  part  of  the  reason  for  this  lies  in  | 

NATO  expenditures.  Improvement  in  this  area  is  made  more  diffi-  j 

cult  by  the  coiplexities  of  decision  making.  j 

Another  area  is  Soviet  electronic  warfare.  They  have  the 
ability  to  cut  off  the  flew  of  our  decision  making  information. 

If  they  can  destroy  30%  of  our  oonmunication  and  disrupt  another 
30%,  they  can  totally  destroy  our  ability  to  camunicate  effec- 
tively. We  need  really  dependable  UHF  radio  and  digital  encoding. 

Currently  we  have  placed  too  much  emphasis  on  security.  We  need 
more  emphasis  on  janming  and  other  offensive  electronic  warfare 
and  less  on  defensive  measures.  The  USSR  is  in  a good  position  in 
Central  Europe  but  they  are  vulnerable.  This  vulnerability  stems 
from  the  tight  control  they  need  to  maintain  over  their  middle 
management. 

The  area  of  intelligence  handling,  processing  and  dissemina- 
tion is  another  that  needs  improvement.  Here,  a major  key  is 
dissemination  of  information  downward.  A good  example  of  this 
is  ITITS  (Intra  Theater  Image  Transmissicxi  System)  used  to  con- 
trol T-39's  in  Southeast  Asia.  But  the  problem  remains  of  exploi- 
ting the  current  system  to  get  information  down  to  the  lower 
levels.  A complication  here  is  the  problan  of  information  over- 
load and  the  problem  of  quantity  versus  quantity.  We  need  to 
cut  the  time  lag  on  this  information  as  well  as  to  deal  more  in 
aggregate  information. 

We  should  also  consider  the  problem  of  enemy  identification, 
the  electrcxiic  sorting  of  Friend  frem  Poe  (FFF)  . This  is  needed 
to  allow  the  use  of  electronic  fire  systems.  This  would  include 
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the  air  traffic  control  system  vrfiich  currently  is  too  cunber- 
soie.  Another  difficulty  in  the  current  system  is  that  it  iden- 
tifies the  friend  and  treats  all  others  as  foe. 

Ihe  last  area  of  concern  is  the  problem  of  deployability  and 
survivability  versus  sophistication.  Current  technology  tends 
toward  sc^histicaticn  and  against  reliability.  Automation  is 
often  needed  but  reliability  should  not  give  way  totally  to 
sophistication . 

Currently  wa  are  experiencing  a trend  toward  overoontrol 
that  may  prove  counter-productive.  The  main  point  here  is  that  we 
shoiild  not  generalize  too  hastily.  The  Mayaquez  incident  bene- 
fited from  real  tine  control  from  the  Pentagon.  However,  we 
cannot  extrapolate  from  this  to  all  other  situations.  In  South- 
east Asia,  we  had  our  own  timetable.  We  were  not  under  attack. 
This  lead  to  control  from  the  White  House.  On  the  other  hand, 
in  the  action  at  Entebbe,  the  Israeli  chief  of  staff  only  lis- 
tened in  to  ground  ccmiunication.  They  had  learned  the  hard  way 
to  stay  out  of  such  decisions. 

Before  closing,  I would  like  to  consider  seme  positive 
notes  - the  things  we  are  doing  right.  The  use  of  airborne  radar 
can  change  C^.  Vie  new  have  the  ability  to  deliver  aggregate  in- 
formation. It  also  reduces  the  need  for  other  information  being 
sent  to  caimand.  Vie  are  making  gains  in  intereperability  and 
information  exchange  between  the  services.  However,  we  tend  to 
overlook  intereperability  with  our  allies.  We  have  also  been 
successful  with  our  lin)cs  beta«^en  research  and  application. 
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AT  SEA:  A COMMANDER'S  VIEW 
ADM.  GEORGE  E.  R.  KINNEAR,  II 


When  you  set  out  to  design  a system  you  usually  have  seme 
specific  purpose  in  mind.  Quite  often  vdiat  you  start  out  to  do 
can  change  due  to  a nunfaer  of  things.  You  have  the  problan  of 
technological  innovation  happening  so  rapidly  that  scmeviiiere  along 
the  line  ycu  have  to  get  tough  and  freeze  the  design  and  quit 
thinking  in  terms  of  what  you  might  do  and  go  on  and  do  semething. 
The  design  may  not  be  perfect  or  may  not  do  all  the  things  that 
you  set  out  to  do  but  at  least  you  have  a "systan."  I think  that 
researchers  are  senewhat  free  about  this  but  certainly  our  appli- 
cations specialists  have  to  think  carefully  about  it. 

As  an  example  of  that,  I know  of  a real  live  case  vAiere  this 
little  old  ]ady  lost  her  husband  and  became  very  lonely.  She  had 
a very  astute  systans  engineer  son  who  took  charge  of  the  situation 
and  said  that  what  you  need  is  companionship.  We  will  get  you  a 
kitten.  Now  if  you  stop  the  design  problem  there  everything  is 
o.k.  because  she  brings  the  kitten  in  and  it  is  very  lovable  and 
a sweet  kitten.  Everything  worked  great.  But  circumstances 
changed  just  as  sure  as  they  change  in  other  parts  of  the  real 
world  and  that  kitten  became  a cat.  It  turned  out  to  be  a male 
kitten.  Then  it  became  a Tcm  cat.  Ton  cats  have  certain  charac- 
teristics that  are  well  recognized  if  you  realize  ahead  of  time 
that  that  kitten  is  going  to  become  a tan  cat.  This  case  was 
typical.  Every  night  he  wont  out  carousing  around  and  then, 
dragged  himself  back  in  the  morning,  often  in  disarray,  physically 
abused,  always  tired  and  hungry.  Instead  of  having  that  cat  as  a 
companion  as  she  set  cut  to  do,  the  lady  had  a cat  she  had  to 
repair,  feed  and  watch  sleep  all  day. 

She  went  back  to  the  systems  engineer  son  and  said  that  it 
was  great  when  he  was  a kitten  but  it  is  not  that  way  anymore. 

Well,  the  son  said,  "that  is  easy  to  fix.  All  you  have  to  do  is 
the  right  kind  of  engineering  and  we  can  return  him  to  his  ori- 
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ginal  state.  We'll  take  him  down  to  the  veterinarian  and  we'll 
get  him  fixed. " So  she  thought  that  that  was  a pretty  good  idea 
and  they  did. 

Then  they  brought  old  Tcm  hone.  He  hit  the  kitchen  floor, 
looked  around,  went  over  and  curled  up  by  the  fireplace  and  went 
to  sleep.  She  thought,  he  doesn't  realize  that  things  have 
changed  and  he  will  be  better  tcmorrcw.  Well,  come  sundcwn,  Tcm 
went  and  scratched  on  the  back  door.  Ihe  lady  thought  about  it 
for  a while  and  then  decided  to  let  him  out.  Itm  went  out  and 
bounced  up  on  the  back  fence.  He  was  up  there  with  several  of 
his  old  buddies  when  one  of  the  more  management-minded  of  the  ton 
cats  said,  "Ttm  (after  being  told  what  had  happened  to  him)  "you 
know  what  they  old  lady  has  done  to  you"?  Tcm  said,  "well,  yes, 

I guess  I do."  His  buddy  said,  "Ton  do  you  realize  the  full 
iirplicaticns  of  this?"  Tan  said,  "well,  what  is  the  bottxm  line 
on  that?"  "Well,  Ton,  the  botton  line  cxi  that  is  that  you  have 
got  to  nake  up  your  mind  whether  you  are  going  to  )3e  a teacher  or 
consultant." 

I am  a naval  officer  primarily  - and  don't  ask  what  is  a 
nice  guy  like  me  doing  in  a job  like  legislative  affairs, 
because  that  story  is  too  terrible  for  the  ordinary  citizen  to 
hear.  Basically,  I am  an  engineer  at  heart,  but  certainly  if  I 
am  anything,  I am  a naval  officer.  Naval  officers  are  in  the 
business  of  producing  cxmbat  capability  at  sea,  for  purposes  of 
controlling  the  seas.  We  have  a mixed  bag  of  people  here. 
Accordingly,  let  me  make  a flat  statement.  I don't  intend  to 
excite  you.  I just  intend  to  generate  a little  interest  on  your 
part,  and  say  that  unless  we  plan  on  going  to  war  with  Mexico  or 
Canada,  there  is  not  going  to  be  a next  war  unless  we  have  con- 
trol of  the  seas.  The  Air  Force  will  not  be  able  to  funcn:ion 
without  its  jet  fuel  and  the  other  kincis  of  things  necessary  for 
air  Wcirfare  that  must  ocme  by  sea.  The  Army  for  the  same  reason 
would  not  last  very  long  without  supplies  and  equipment  corried 
by  sea.  So  I take  ray  business  of  seapcwer  very  seriously. 


Not  to  have  coimand  of  the  seas  - and  you  would  assune  that 
we  have  the  forces  necessary  to  maintain  control  of  the  seas  - 
involves  the  solution  of  a nuitber  of  problems.  Let  me  illustrate 
this  for  you  with  a current  exanple.  A few  years  ago  I went  to 

sea  as  a oonmander  of  a carrier  group.  My  first  introduction  to 
2 i 

where  we  were  both  in  C and  C at  sea  in  a tactical  situation 
came  in  the  following  form:  I was  sitting  on  the  flag  bridge 
of  the  U.S.S.  Kitty  Hawk  near  Singapore  looking  at  a couple  of 
ships  that  were  working  a very  sinple  problem.  We  were  trying  to 
move  to  the  South  China  Sea  without  any  aircraft  caning  out  of 
Guam  being  able  to  identify  which  radar  blip  was  the  carrier,  some- 
thing we  practice  all  the  time.  There  are  all  kinds  of  ways  of 
fooling  aircraft  that  are  looking  for  carriers  at  sea.  The  first 
time  that  we  have  to  comiunicate  they  have  us,  just  about, 
unless  we  are  playing  the  game.  Vfe  had  no  destroyers  in  company 
with  us.  Vfe  had  detached  than  for  individual  ship  exercises  over 
the  horizon  about  20  miles  away.  We  were  using  helicopters  for 
plane  guard  and  were  conducting  fli^t  operations  at  that  time. 
Kitty  Havdc  was  the  first  multipurpose  carrier  in  the  Pacific 
environment.  She  had  a pretty  naat  mission.  Everybody  for 
whom  I worked  made  very  clear  what  ity  goal  was. 

Ife  had  a replenishment  group  with  one  of  our  newer  replenish- 
ment ships  at  the  center  of  the  formation  about  40  miles  back. 

They  were  on  a slightly  different  course  in  order  to  keep  the 
wind  and  sea  in  the  right  position  for  an  easy  replenishment  at 
sea.  Things  were  going  very  neatly.  Sunday  morning,  li^t 
winds,  nice  sea  state, and  I was  for  the  first  time  feeling  the 
full  glory  of  ccmmand  at  sea.  I got  a garbled  radio  message 
that  said  words  to  the  effect  "...  this  is  the  replenishment 
groi;f)...  we  have  a submafine  back  here  with  us."  Vfell,  that 
did  not  sound  too  serious,  except  that  we  did  not  have  a sub- 
marine that  was  supposed  to  be  a part  if  the  exercise. 

I had  a very  well  qualified  staff  and  being  the  new  boy  on 
the  block  I did  what  any  reasonable  comander  would  do.  I 
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thought  to  nyself,  "Okay,  this  is  a wonder  time  for  me  to  keep  my 
mouth  shut  and  watch  ny  staff  go  into  action. " The  first  thing 
they  did  not  try  to  go  to  other  sources  and  find  out  if  there 
was  a sutniarine  that  we  are  aware  of  in  this  general  area.  That 
is  the  sort  of  stock  first  step  in  that  sort  of  situation.  The 
second  thing  they  did  was  say,  "let's  break  off  the  exercise  with 
the  aircraft  that's  coning  down  to  lode  for  us,  go  into  our  Aa^ 
node  and  cancel  our  exercise. " 

That  was  a little  distressing  to  me  because  I have  the 
feeling  that  if  we  go  to  war  with  the  Russians  they  are  not  going 
to  let  us  fi^t  the  war  in  jiiases.  We'll  not  be  able  to  do  ASW 
part  of  the  time  and  anti-air  part  of  the  time  and  then  get 
around  to  the  anti-surface  later.  We  have  to  be  able  to  do  all 
at  the  same  time.  I became  screwhat  disquieted. 

We  had  an  airborne  early  warning  aircraft  tp,  so  I 

sug^sted  "Why  don't  we  move  him  back,  use  him  as  a ccrmunicaticxis 
relay,  keep  the  air  exercise  going  and  see  if  we  ca^^'t  approach 
this  as  a single  problem.  It  turned  out  that  it  was  not  a sub- 
marine that  they  had  reported.  It  was  a periscepe.  Until  we 
could  verify  the  information  we  had  on  the  submarine,  I decided 
to  keep  working  the  air  problem.  "In  the  meantime,  I said,  "why 
don't  you  call  the  destroyers  that  are  on  individual  ship 
exercises  over  the  horizon  and  head  them  back  that  way." 

Well  that  sounded  sinple  until  I found  out  that  we  could  not 
raise  them.  We  were  trying  to  stay  off  HF  because  of  the  air 
problem,  knewing  that  if  we  came  ip  on  HF  that  aircraft  would  have 
a fix  on  ut.  We  could  not  ccrminicate  with  our  own  destroyers, 
althou^  they  were  less  than  20  miles  away,  and  get  them  headed 
teward  the  flSW  contact.  It  was  very  interesting,  because  by  seme 
freak  we  were  able  to  camiunicate  with  the  replenishment  group 
twice  as  far  away  in  a slightly  different  direction. 

I won't  belabor  you  with  the  whole  thing,  but  I suddenly 
became  aware  that  there  were  a nutttoer  of  prctolems  that  had  not 
been  solved  since  the  last  time  I had  been  at  sea.  Oie  of  than 
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was  tactical  ccmtunicaticxis  at  sea.  That  is  not  really  the  main 
thrust  of  what  you  are  doing  here,  but  I will  oone  back  to  it 
because  it  is  central  to  everything  that  we  have  to  do  with  res- 
pect to  ccninand  and  ccntrol.  You  can  build  all  the  management 
infomation  systems  that  you  want,  but  if  you  don't  have  the 
ability  to  implement  your  decisions,  to  know  how  your  inplanenting 
actions  are  going  and  to  get  feedback,  you  are  in  serious  trouble. 

You  can  forego  a oonmunications  system  up  to  the  time  of  making 
the  decision  but  decisions  are  useless  if  you  have  an  inadequate 
tactical  cdimunicaticxis  system.  So  you  cannot  neglect  the  third 
C of  oannunications  although  I know  the  purpose  that  you  are 
down  here  forprinarily  you  are  interested  in  the  first  two. 

I will  put  on  ray  professorial  mode  new  and  tell  you  that  most 
oatmanders  at  sea  have  a mission,  that  they  are  well  aware  of. 

Perhaps  I am  telling  you  that  I should  have  been  the  first  lec- 
turer this  morning  after  hearing  the  sophisticatican  of  the  pre- 
vious one.  You  may  be  relieved  to  know  that  I am  going  to  oerment 
on  a real  grassroots  level  situation  as  a simple-minded  cenmander 
at  sea  with  problems  and  in  need  of  seme  help. 

Within  our  mission  we  have  specified  tasks,  (jertainly  the 
capable  oonmander  will  have  defined  the  priority  of  the  tasks 
within  his  missicxi  even  if  hi^er  cotttnand  hcis  not.  He  will  make 
these  priorities  abundantly  cleeu:  to  his  subordinates.  If  he 
doesn't,  he  has  lost  "at  bat"  even  before  he  starts. 

In  addition  to  knowing  his  mission  and  tasks,  and  having 
everything  ordered  in  priority,  he  nust  also  have  full  apprecia- 
tion of  the  resources  he  had  available  to  him.  those  resources 
can  come  in  many  forms.  They  can  be  basic  weapons  systems,  black 
bcnces,  the  people  idio  make  them  go,  all  forms  of  support,  every- 
thing under  the  sun  that  can  in  any  way  contribute  to  the 
acocmplishment  of  your  mission  at  sea.  Then,  of  oourse,  the  other 
thing  that  he  has  to  have  a good  knowledge  of  and  he  has  to  have 
a full  appreciation  of,  is  his  staiff.  j 


Itiere  are  three  basic  things  that  are  threaded  throng  this. 
Oie  of  them  is  data.  One  of  them  is  information.  And  one  of  than 
is  decision.  You  say,  that  is  so  simple,  why  do  you  even  bother 
to  beat  us  over  the  head.  Well,  let  me  tell  you  that  I have  a 
great  problem  cotimunicating  in  my  own  ccmunity.  I don't  know 
if  you  have  this  problem  or  not,  but  the  siitple  distinction  bet- 
ween vihat  is  data  and  what  is  information  is  difficult  in  my 
caiitunity.  I have  a very  simple,  straightforward  theory  about 
organizations  and  I have  got  one  about  the  difference  between 
data  and  information.  Let  me  tell  you  this  theory  about  informa- 
tion and  organizaticais.  You  have  probably  been  exposed  to  both 
already  today.  There  is  no  orgcinization  in  the  world,  no  matter 
hew  cleverly  and  how  well  designed  it  is,  that  can't  be  screwed  up 
if  you  get  the  wrong  bunch  of  human  beings  in  there  trying  to 
make  it  go  unless  it  is  going  to  be  a system  that  does  not  require 
hunan  participation  (and  it  is  hard  to  find  one) . It  does  not 
make  any  difference  how  well  the  engineer,  systems  designer  or 
anybody  else  does  their  work.  You  get  the  wrong  bunch  of  people 
in  there  and  they  can  screw  it  up.  By  the  same  teJeen  you  can  take 
the  worst  designed  system  - at  least  theoretically  worst 
designed  system  - and  if  you  give  me  the  right  collection  of  people, 
I will  make  it  work  for  you.  I don't  care  how  bad  it  is.  It  may 
not  be  a perfect  performance,  but  I can  make  the  dam  thing  work 
for  you.  I guess  the  point  is  that  quite  c^art  from  the  hardware, 
from  the  design,  from  all  of  the  thinking  that  goes  into  putting 
a system  together,  you  can  never  neglect  the  human  element.  It  is 
going  to  be  in  there  and  you  have  to  design  that  system  for  the 
least  capable  hunan  being  that  is  going  to  try  to  use  it.  If  you 
don't  believe  that,  I can  give  you  a lot  of  exartples. 

New,  to  the  difference  between  data  and  information.  I don't 
want  to  belabor  this  point.  This  was  a good  point  that  Dr.  Miller 
rtade  as  he  went  through  the  hierarchy  of  sophistication.  What  is 
information  at  one  level  may  be  data  at  another  level.  The  point 
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is  that  the  raw  data  itself  is  very  seldom  useful  in  decision 
making.  It  has  to  be  processed  in  sane  way.  Vihat  turns  out  to  be 
information  at  one  level  in  a form  perfectly  adequate  for  hhat 
has  to  be  done  at  that  level  has  to  be  processed  again  to  be 
suitable  at  a higher  level  of  sophistication.  He  mentioned  this 
very  specifically,  this  conpression  factor  that  you  keep  refining 
as  it  goes  upstream.  As  it  cones  down  frcm  the  top,  of  course,  it 
has  to  work  in  the  opposite  manner.  Think  about  that,  and  keep 
it  in  mind  anytime  you  build  a system  that  is  going  to  be  used 
for  the  purposes  of  caimand  and  oontrol. 

The  only  reason  that  you  have  for  gathering  data,  processing 
it,  creating  infometion,  refining  it,  and  driving  it  upstream  in 
any  systan  is  that,  ultimately,  it  is  going  to  contribute  to 
making  a decision.  Then  there  is  the  other  inportant  aspect. 

Decisions  having  been  made  are  useless,  in  general,  unless  they 
are  implenented.  You  have  the  other  side  of  the  process  to  cone 
down,  so  to  speak. 

If  I talk  in  terms  like  that,  you  say  "Well,  all  he  is 
talking  about  is  "MIS".  He  says,  "Design  me  a managanent  informa- 
tion system."  That  is  all  he  really  wants.  By  golly,  you're 
ri^t.  You  can  make  the  case  that  the  only  thing  I need  to  be 
effective  in  caitnand  at  sea  is  a pretty  good  mancigement  infor- 
mation systan.  Now  what  would  I need  in  that?  Again,  I have 
given  you  a very  basic  approach  to  this  thing,  but  these  are  the 
things  that  I would  have  to  consider  before  I made  any  )d.nd  of 
tactical  decision.  I would  have  to  knew  what  I have  in  the 
way  of  ny  own  forces.  Well  that  is  easy,  I count  than.  You 
have  a list  of  them.  It  is  easy  to  knew  hew  mary  ships  and  air- 
planes you  have,  their  capabilities  and  that  kind  of  thing.  But 

there  are  sane  other  things  to  consider  and  you  might  note  that  i 

you  can  define  two  general  catageries  of  information.  Ycu  have  ] 

static  information.  The  kind  of  stuff  that  you  knew  that  you  j 

could  put  into  a data  base.  It  changes  very  slcwly,  if  at  all,  j 

and  quite  often  it  is  an  "in  or  out"  kiiid  of  thing.  Either  a | 
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ship  is  aflcMt  or  it  is  sunk,  you  know  that.  Then  you  also  have 
dynamic  infonnaticn  which  gives  you  scmething  beyond  that.  It 
changes  very  rapidly.  You  can  make  the  distuictions  between 
those  two  categories  very  easily. 

Sanewhere  in  the  fast  ncving  tactical  situation  you  have 
to  start  taking  into  account  intent.  But  that  puts  you  into  a 
probabilistic  situation,  and  the  information  I am  talkirg  about 
is  rtuch  more  certain  than  that.  Ihe  guy  either  has  the  capa- 
bility or  he  doesn't.  Either  he  has  a missile  systan  or  he 
doesn't  have  a missile  system.  If  he  has  a missile  systan, 
either  it  is  working  or  it  isn't.  The  last  thing  is  if  that 
missile  systan  is  working,  has  he  any  missiles  left  to  shoot? 

That  is  more  of  the  dynamic  information.  So,  if  you  have  an  ideal 
managanent  information  system  for  tactical  decisions,  you  would 
have  sene  neat  things  in  there.  Pretty  easy  to  get  these  c«i  your 
cwn  task  force  as  to  not  only  vtot  you  have  with  you  and  vAiat 
your  capabilities  are,  but  also  vAiere  they  are.  That  is  a tough 
problan. 

let  me  make  a point  here  because  there  is  a variety  of 
pecple  here  with  different  backgrounds.  That  is  that  the  toijghest 
problem  that  you  would  have  would  be  the  air  warfare  problem,  as 
regards  tactical  decision  and  oaimand  control.  The  easiest  pro- 
blem we  should  have  would  be  the  one  at  sea.  I would  like  to 
tell  you  the  Navy  has  it  solved  but  I am  sure  that  you  have  dis- 
cerned about  new  that  I don't  think  we  have.  Actually  the  one 
that  should  be  the  most  manageable  - and  if  you  take  a look  at 
the  requirements  for  management  information  systems  you  can  see 
why  - would  be  the  one  at  sea  vAiere  ycu  have  a relatively  simple 
sterile  environnent.  A lot  of  things  in  the  air  battle  situation 
happen  very  rapidly  but  in  general  the  things  that  happen  on  the 
surface  and  the  subsurface  part  happen  at  relatively  slow  speeds  - 
and  ycu  don't  have  the  casual  intruder.  Even  in  air  warfare,  you 
can  have  a casual  intruder.  Most  pecple  like  to  stay  away  frem 
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fighter  pilots  vHyo  have  loaded  missiles  and  that  sort  of  stuff, 
viiether  he  is  flying  another  airliner  or  fighter.  It  is  even 
more  nenageable  under  sea  conditions.  I would  like  to  think  that 
if  you  are  going  to  look  at  a basic  problem,  that  you  would  think 
of  the  sea  problem  because  that  is  pretty  manageable  compared  to 
sane  other  things.  I suppose  there  are  probably  aniling  ccmnan- 
ders  here  that  are  amazed  to  hear  me  say  that  I think  their  prob- 
lem is  tougher  than  mine  - there  are  too  many  variables  in  land 
warfare  that  I don't  have  to  deal  with. 

What  I want  to  know  in  a real  or  potential  combat  environ- 
ment is  the  disposition  of  ny  own  forces,  v\tiat  kind  of  condition 
they  are  in,  - in  other  wards  the  capabilities  that  are  built 
into  each  individual  ship,  each  individual  airplane,  and  how 
many  will  operate.  Hew  many  missiles  do  they  have  left?  Hew 
many  rounds  of  amnunition?  You  must  knew,  if  you  are  in  battle, 
the  present  condition  of  the  units  and  pproblans  that  are  not 
just  a itBtter  of  every  day  maintenance  — not  just  the  sort  of 
thing  that  you  are  normally  reporting,  but  special  battle  report- 
ing to  tell  you  how  you  are  foing  frem  the  standpoint  of  material 
conditicxi,  capabilities,  casualties,  equipment  and  expendables. 

If  that  is  what  you  want  to  know  about  your  own  forces,  what 
about  the  threat  forces?  Pretty  obviously,  you  want  to  know  the 
same  thing.  You  want  to  know  the  ccxnpositiai  of  the  threat 
forces,  and  you  want  to  know  their  cap>abilities.  Static  and 
basic.  On  the  dynamic  side,  you  want  to  know  the  where  and  when. 
Where  are  they  and  when  were  they  there  and  that  sort  of  thing. 
The  older  the  when,  the  less  certainty  there  is  about  the  where. 
You  people  who  like  to  deal  with  probability  can  take  a look  at 
tlat  problem  and  help  us  solve  it,  particularly  when  it  comes  to 
building  decision-making  models. 

If  you  have  that  kind  of  information,  where  do  you  get  it 
and  how  do  you  use  it.  One  of  the  things  that  I found  out  on 
Kitty  Hawk  was  that  I did  not  have  the  ability  to  handle  the 
volime  of  information  generated  by  ny  own  forces.  How  d > naval 
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forces  at  sea  generate  information?  Well,  they  collect  a lot  of 
data  and  they  process  it  in  different  ways.  What  are  the  data 
collectors,  what  are  the  information  collectors,  depend  on  how 
you  want  to  look  at  it.  What  are  the  general  categorizations 
that  you  can  assign  these  collectiors.  Passive  and  active. 

Which  is  better?  Man,  give  me  the  passive  one  every  time.  The 
active  infomaticsi  gatherer  like  a radar  gives  you  real  fine  in- 
formation, is  very  useful,  but  you  give  that  other  guy  an  awful 
lot  of  information  in  return.  Sonar  is  the  same  way.  I prefer 
sonar  to  active  sonar.  The  information  you  gather  is  much  more 
valuable  to  you  if  your  enemy,  real  or  potential,  doesn't  know 
that  you  have  gathered  it. 

Let  me  at  the  same  time  say  this  about  ccm  munications  sys- 
tans.  Think  how  vronderful  it  would  be  if  we  had  ccmnunication 
systems  that  met  all  the  requiranents  in  terms  of  speed  ard 
reliability  and  security,  and  yet  were  passive.  Just  think  of 
having  the  ability  to  ccmunicate  without  the  enemy  knowing  that 
you  are  caimunicating.  Right  new  we  can  keep  them  fron  under- 
standing vhat  we  are  cctnmunicaticng,  - but  they  know  that  we  are 
oormunicating  in  just  about  every  system  that  he  use. 

We  have  got  all  of  this  data,  all  this  information  and  we 
can  build  a tremendous  data  base  and  we  can  inundate  ourselves 
with  the  informatics  generated  at  the  local  level  alone.  In 
today's  world  this  is  just  not  enough.  The  ability  of  the 
eneiiy  to  launch  long  range  missiles  frem  sutmerged  sutmarines 
surface  ships,  and  backfire  bombers,  or  other  ciir  platforms, 
makes  a situation  vrtiere  you  simply  cannot  be  concerned  solely 
wrLth  the  information  that  you  generate  locally.  You  may  be 
making  a lot  of  quick,  short  term  decisicss  based  on  what  you 
generate  locally,  but  if  you  cure  going  to  survive,  you  have  to 
knew  what  is  happening  over  the  horizon  and  beyond  radar  range. 
You  simply  do  not  have  the  time  with  the  weapons  systans  that  we 
have  new,  and  that  we  will  have  in  the  future,  th  survive  a 
saturation  attack  at  sea  unless  you  have  sane  prewaming  of  what 
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is  ccming  and  utere  it  is  caning  fron.  That  means  that  you  prob- 
ably will  be  tied  in  to  other  sources  of  information  that  are 
exterior  to  your  own  task  group,  vtiether  those  sources  are  other 
naval  forces  at  sea,  satellites,  or  whether  they  are  other  central 
systans  owned  by  other  agencies  of  the  government.  It  makes  no 
difference  fron  where  it  cones.  You  still  must  have  a way  of 
tapping  that  kind  of  system  if  vie  really  get  serious  ^lbout  war 
at  sea. 

If  you  have  all  that  infornetion  dumped  into  the  data  base, 
obviously,  you  must  have  sane  way  to  use  it.  You  have  gathered 
it,  you  have  stored  it,  now  you  must  have  seme  way  of  sorting  it, 
being  able  to  call  it  in  a form  and  a time,  and  in  a fashion  that 
helps  you  make  orderly  decisions.  Here,  the  software  people  cone 
into  their  own.  They  can  once  again  saturate  you.  There  are 
numbers  of  ways  that  you  can  sort  that  information,  depending  on 
how  you  have  built  your  data  base.  Let's  say  we  have  had  an 
intelligent  design,  and  that  you  have  an  almost  unlimited  number 
of  ways  that  you  can  call  that  information.  In  the  case  of  ECN 
or  electronic  signatures,  it  can  be  by  frequency,  it  can  be  by 
pulse  repetitioi  rate,  or  any  of  the  parameters  that  can  go  to 
describe  the  electronic  signal.  You  can  sort  by  them.  You  can 
see  that  the  conbinations  available  are  almost  unlimited. 

Having  done  that,  you  need  soie  way  of  presenting  that  to 
the  decision  maker.  If  you  stop  to  think  about  the  number  of 
ways  you  can  present  information,  right  off  the  bat  you  have 
CRT's,  you  have  teletype,  you  have  voice.  It  can  be  a large 
screen  display.  There  is  a \*hole  family  of  those,  whether  you 
use  liquid  crystals  or  light  values.  There  are  almost  unlimited 
conbinations  there  of  hew  you  can  display  information.  When  you 
get  down  to  that  point  Vvtere  you  are  going  to  display  information, 
you  are  doing  it  for  a purpose,  and  that  is  to  make  a decision. 

I think  we  are  finally  at  a point  where  you  applications  people 
can  address  a real  problem.  You  could  cone  up  with  sane  good 
software  programs  that  will  assist  the  decision  maker  by  letting 
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him,  before  hand,  build  seme  decision  models.  We  could  build 
models  that  have  provisions  for  stochastic  processes.  Those 
stochastic  models  certainly  would  not  be  infallible,  but  they 
certainly  would  be  an  aid  to  the  tactical  decision  maker.  Speci- 
fic applications  such  as  taking  electronic  signatures  and  the 
sequence  in  which  those  signatures  appear,  and  the  direction  and 
the  speeds  of  the  emitters  and  that  sort  of  thing,  you  can  come 
up  with  seme  pretty  solid  patterns  as  to  what  the  enemy  is  doing. 
One  of  the  problems  that  you  always  have  is  the  possibility  that 
you  are  being  spoofed.  So  you  are  going  to  have  to  build  seme 
sort  of  check  systan  to  discriminate  between  the  spoof  signal 
and  what  is  probably  a real  signal.  Certainly  there  is  almost 
unlimited  opportunity  to  take  a look  at  all  the  information  that 
is  being  put  into  that  data  base,  select  out  of  these  certain 
things  that  satisfy  the  requiranents  of  your  decision  model,  and 
display  that  is  such  a way  that  the  decision  meiker  will  have  an 
additional  aid. 

The  big  fear  of  everybody  vihen  you  talk  about  this  is  they 
are  going  to  ask  the  ccrinander  to  give  up  his  own  intellect  and 
depend  on  a computer  to  make  a decision  for  him.  Not  so,  at 
least  in  my  estimation.  It  is  an  aid  to  the  decision-maker. 
Nothing  more,  nothing  less.  There  is  atremendous  amount  of 
research  that  has  already  been  done  in  this  area.  There  are 
some  great  models  already  working.  There  are  sane  terribly  smart 
people  that  are  pursuing  R & D in  this  area.  I can  think  of 
norhting  more  challenging  to  use,  and  more  useful  to  me,  then  to 
be  able  to  come  up  with  those  kinds  of  decision  models  and  tie 
than  into  a computerized  tactical  coimand  center  at  sea. 

The  last  part  of  this  process  comes  after  having  made  a 
decision.  Sometimes  the  decision  is  not  to  do  anything,  but  in 
a combat  situation  usually  the  decision  is  to  get  out  and  do 
something.  It  is  ein  aggressive  action  done  in  a timely  fashion. 
The  system  that  you  built  has  to  be  able  to  track  the  implemen- 
tation of  your  decision  and  provide  you  the  feedback  necessary 
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for  the  next  generation  of  decision.  Let  me  say  that  anybody 
who  is  going  into  ocxnbat  vouid  like  to  know  he  has  a 99%  prcto- 
ability  of  winning.  You  can  find  yourself  in  a situation  where 
you  lose  a battle  and  it  is  not  a mistake  in  the  system.  The 
tactical  comander  did  not  do  anything  wrong.  He  simply  was  in 
a situation  vhere  he  was  destined  to  lose.  Somebody  else  may 
have  made  a mistake,  but  it  certainly  was  not  even  at  the  theatre 
f level.  It  may  have  been  a coincidence,  such  as  a typhoon  that 

kept  him  from  eiiploying  the  forces  he  had  available.  I don't 
I like  to  think  in  terms  of  mistakes.  I like  to  think  of  relooking 

j at  the  situation  as  it  exists  at  a given  time  and  to  decide  vhat 
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will  happen  next.  It  doesn't  matter  whether  it  was  a mistake,  or 
on  purpose,  or  an  act  of  God,  or  whatever.  The  data  base  should 
be  absolutely  insensitve  as  to  motivation  and  how  you  got  like 
you  are.  It  does  have  to  be  a system  that  is  sensitive  to  deci- 
sicxi  implanentation  and  takes  care  of  that  last  bit  of  feeding 
back  to  the  total  system  so  that  the  decision  maker  is  in  a 
dynamic  process  at  the  time. 

I have  already  mentioned  the  fact  that  the  key  to  this,  and 
also  I might  add,  the  key  to  gathering  data,  passing  information 
and  implementing  decisions  and  getting  feedback  is  to  have  a 
ccrmunicaticns  system.  I don't  knew  how  the  rest  of  you  are 
doing  but  with  what  I had  to  operate  at  sea  and  what  I ^ee  going 
‘ aboard  our  ships  the  Nav^'  is  not  impressive  in  this  area.  I 

mi^t  enjoy  getting  in  the  last  word  here  by  saying  don't  believe 
those  that  say  satellites  will  solve  all  of  this.  If  you  want  to 
hear  my  caustic  ccnments  on  satellites,  I was  in  an  operational 
exercise.  Nickel  Plate,  when  I was  out  in  WEST  PPC,  and  I saw 
operational  inmediate  messages  caning  in  24  hours  after  they  were 
issued.  The  systan  became  hopelessly  strangled.  It  may  have 
looked  great  back  at  the  Pentagon  but  at  the  other  end  it  did  not 
look  so  good.  Mmiral  Steele,  who  was  the  cemnander  of  the  7th 
fleet  at  the  time,  came  over  and  he  said,  "they  tell  me  that  this 
whll  be  corrected  and  that  we  won't  have  to  depend  on  HF  cemuni- 
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cations.  We  will  have  the  satellites  and  we  will  go  all  SHF, 

UHF,  whatever.  We  won't  have  all  the  problems  any  longer.  But 
that  worries  me  a little  bit,  because  the  first  thing  vrfien  the 
balloon  goes  up,  the  satellites  are  going  to  cone  down."  I 
thought  about  that  for  a while  and  after  watching  up  operate 
out  there  I said,  "If  the  Russians  really  know  what  they  are 
doing,  they  will  leave  the  satellites  up." 

I had  not  intended  to  stagger  your  inagination.  I have 
intended  to  stimulate  what  you  might  have  considered  an  oppor- 
tunity to  pick  the  brain  of  a guy  \dio  has  been  pretty  frustrated 
in  his  own  personal  attenpts  to  solve  the  kinds  of  problems  that 
we  are  talking  about.  I did  ccme  up  with  sonething  called  Outlaw 
Hawk,  thanks  to  Julian  Lake.  Lots  of  hard  work  by  Nell  Nauglex 
and  my  staff.  We  put  together  a ccmputerized  tactical  conmand 
center  on  board  the  Kitty  Hawk  using  "off-the-shelf  hardware." 

We  gained  an  awful  lot  of  knowledge  as  far  as  demonstrating 
different  concepts.  Vfe  did  not  establish  how  the  Navy  shauld 
to  in  solving  the  TPCC  Prci)lan,  which  is  only  part  of  the  overall 

3 

C problan.  We  did  establish  that  a ccmputerized  system  is 
necessary  to  optimize  on  which  our  existing  hardware  systems  can 
do,  and  that  software  is  the  real  challenge  in  respect  to  how 
to  go.  It  was  also  demonstrated  that  ccrmunications,  both 
internal  and  ‘ixtemal,  are  probably  the  limiting  element  of 
in  todays  ccntat  environment. 
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DISCUSSION 

Dockery:  I have  been  making  an  observation  about  your  decision 
models.  It  seems  like  viiat  you  are  really  talking  about  there  is 
a software  package  of  real  time  inforration  about  which  only  a 
sort  of  trip  wire  decision  is  nade;  for  which  only  some  sort  of 
very  simple  algorithm  exists  which  says  that  if  it  is  above  sate 
threshold,  display  it.  I think  this  is  the  step  between  there 
and  scrething  like  that,  but  it  would  make  a distinction.  I 
think  you  are  talking  about  a package,  is  that  correct?  Something 
that  packages  their  real  time  information. 

Kinnear:  Well,  you  are  getting  into  deep  water  - what  do  you  mean 
by  real  time  information? 

Dockery:  I think  the  radar  sensor  data  - the  flowing  in  of  rela- 
tively indigested  information,  pieces  of  equipment,  or  people  who 
press  a button  that  enter  seme  type  of  data  produced,  as  opposed 
to  really  evaluated  information. 

Kinnear:  O.K.,  it  depends  on  the  level  of  the  decision  you  are 
planning  on  making.  Of  course  the  thing  we  have  new  in  lieu  of 
that  in  view  of  the  fact  that  we  have  the  human  intellect,  is  the 
staff.  That's  the  only  thing  that  kept  me  alive  — the  fact  that 
I had  a well  qualified  staff  when  we  got  into  a tough  situation. 
Incidentally,  twro  conditions  usually  existed.  One,  you  didn't 
have  enough  information  to  make  an  intelligent  decision,  and 
secondly,  you  had  tore  unevaluated  information  which  had  not  been 
properly  put  together  than  you  could  handle  and,  and  a result  of 
which,  ycu  got  saturated.  There  never  seeited  to  be  an  in-between. 
Of  course,  the  way  to  cut  through  the  last  one  is  to  have  a very 
knowledgeable  set  of  software  walking  around  on  Lwo  feet  you  help 
you  whth  that  problem.  Of  course,  they  are  preprogranmed  in  a 
lot  of  different  ways  and  if  you  have  been  snart  about  the  kind 
of  people  ycu  have  on  ycur  staff,  hopefully  you  will  have  a mutu- 
ally supporting  group  of  software  programs  there  that  can  get  you 
around  the  problem  you  are  talking  about.  As  for  what  I am 
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talking  about  ultimately  downstream,  the  alternative  suggestions, 
that  is  one  thing  that  would  have  to  be  an  output.  It  would  have 
to  give  you  an  evaluation  and  then  a recotmendation  of  sane  sort. 
But  as  to  hew  high  you  can  drive  that  thing  through  a cemputer,  I 
am  a little  uncertain  right  now.  Unfortunately,  semething  you 
are  going  to  find  out  when  you  get  into  this  thing,  is  that  v4iat 
is  considered  to  be  optimum  by  the  operator  is  going  to  be  a func- 
tional by  the  individual  and  the  people  that  he  is  working  with. 
Hew  much  help  does  he  want  fretn  it?  I didn't  answer  your  question. 
It  appears  that  in  order  to  be  a real  decision  maker,  it  has  to  be 
a model  to  a certain  degree  of  both  yourself  and  your  staff.  It 
has  to  be  able  on  the  basis  of  the  infonnation  available  to  gene- 
rate, say,  the  four  or  five  most  com  on  alternatives  one  of  v^iich 
ycu  will  accept  when  presented  or,  if  you  reject  than  will  gene- 
rate new  ones.  The  step  between  that  and  the  sort  of  simple  pro- 
cessing you  are  talking  about  is  a rather  critical  one. 

MJdrick:  "One  way  to  look  at  the  cemputer  aided  cermand  center 
and  decision  aiding  is  that  it's  necessary  because  the  staff  is 
overburdened  with  the  information  processing  that  they  originally 
did.  There  are  several  ways  I can  ask  the  question,  one  is:  if 
you  go  to  the  cemputerized  operation,  are  you  willing  to  give  up 
the  staff  that  it  is  replacing  or  to  put  it  pejoratively,  is  this 
a sneaky  wah  to  increase  manning  by  buying  computers  instead  of 
people?" 

Kinnear:  It's  a trade  off  in  my  estimation.  I will  give  you  a 
personal  answer  on  that.  I would  never  think  of  getting  rid  of 
my  staff  for  a number  of  reasons.  You  may  be  able  to  reduce  the 
size  of  your  staff  if,  in  fact,  the  only  reason  they  are  there  is 
to  help  you  make  decisicais.  But,  of  course,  as  we  realize,  the 
control  of  the  data  base  and  the  kinds  of  things  that  go  into 
that  and  the  ability  to  get  meaningful  things  fron  a data  base 
is  usually,  at  least  with  the  kinds  of  situations  I am  familiar 
with,  very  dependent  on  the  kind  of  people  you  have  on  the  staff. 

So  they  have  got  two  functions:  one,  they  aid  you  in  decision 
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making.  The  other  thing  is  that  they  are  really  the  people  viho 
are  writing  the  orders  cuid  determining  the  design  of  your  data 
base  in  a dynamic  fashion  as  far  as  Vv^iat  you  are  putting  in  there, 
and  have  the  ability  to  put  the  right  kinls  of  things  in  there. 
Lord  kncws  there  is  not  a ccmputer  in  the  world  big  enough  to 
store  everything  you  might  want  to  know,  so  you  have  to  be  selec- 
tive. The  other  thing  is  correlating  the  information  you  have 
got  in  there.  You  can  build  a routine  that  will  do  a great  job 
in  assisting  you  in  correlation,  but  one  thing  we  found  out  in 
Outlaw  Hav^<  is  that  while  a ccmputer  can  be  a great  assistance  in 
that,  the  best  system  you  have  got  in  correlation  between  very 
diverse  bits  of  information  is  the  human  brain.  On  a particular 
target  ws  had  3“^  elements  in  there,  information  elements,  if  you 
will,  and  if  we  can  de  ermine  15  of  them  I can  essentially  give 
you  the  names  of  the  platforms  or  the  bureau  numbers  of  the  air- 
plaine  - only  15  of  that  35  can  do  that.  The  ccmputer  is  pretty 
stupid.  It  can  really  handle  a lot  of  stuff  - but  as  far  as  its 
ability  to  pull  things  together  and  make  a determination  as  to 
what  that  platform  was,  and  correlate  the  different  kinds  of  in- 
formation - electronic  signature  wdth  the  acoustic  signature  with 
other  kinds  of  information  you  might  have,  - that  process  still 
required  the  hutan  being.  I think  what  might  happen  is  that  if 
you  build  me  decision  models  that  would  hekp  me  in  my  tactical 
decision  making,  I would  still  want  to  keep  my  staff.  I would 
still  knew  that,  as  far  as  managing  a data  base,  particularly  in 
the  correlaticn  function,  I would  have  a different  kind  of  staff, 
but  it  would  still  be  there. 

&iestion:  "I  was  interested  that  you  started  off  saying  you  knew 
what  you  vranted  to  do  when  you  went  to  sea.  You  had  a pretty 
good  idea  - you  stated  your  mission,  you  had  your  task.  That's 
sort  of  standard,  everybody  carries  that  around  with  them.  One 
of  the  things  we  had  difficulty  in  trying  to  evaluate  what  you 
were  doing  in  Outlaw  Hawk  was  in  deciding  what  your  mission  was, 
what  you  were  really  trying  to  do.  Navy  officers  carry  that 


around  very  nicely  themselves  and  keep  it  well  undisclosed,  be- 
cause I was  watching  than  in  operation.  I think  that  might  be 
the  source  of  a great  deal  of  difficulty  in  trying  to  create 
facilities  like  TSC  and  Outlaw  Havrf<  and  other  such  things,  be- 
cause you  don't  agree  among  yourselves,  because  you  don't  let 
each  other  knew  vAiat  you  are  thinking.  It  is  just  a suggestion 
or  a challenge,  you  might  say. 

Kinnear:  No,  it  is  probably  a legitimate  connent.  It  doesn't 
particularly  fit  me  of  course,  but  as  much  as  you  were  there, 
you  have  every  right  to  make  it.  The  thing  that  doesn't  go  along 
with  Outlaw  Ha\«^e,  of  course,  is  the  operational  order.  I don't 
believe  it  went  along  with  vAiat  we  were  supposed  to  be  doing  on 
the  many  different  phases  of  that  particular  operation.  We  pro- 
ceeded about  ten  days  in  that.  Of  course,  even  after  you  finished, 
there  was  sane  uncertainty  as  to  viiat  it  is  we  thought  we  were 
doing.  That's  sort  of  like  being  in  Washington.  You  stop  any 
nimber  of  people  in  the  Pentagon  and  ask  them  vihat  the  mission 
of  the  Department  of  Defense  is  and  you  will  get  as  many  diffe- 
rent answers  as  you  do  people.  If  you  like  the  one  about  the  ant 
floating  down  the  river  on  a log.  As  long  as  it  is  going  down- 
strram  you  could  ask  ary  ant  on  there  and  he  would  tell  you  that 
he  was  steering,  but  you  let  the  damn  thing  turn  around  and  each 
one  will  turn  to  the  other  and  "but  I though  you  had  the  conn". 

It  is  scmevihat  that  way  in  large  operations  at  sea.  Hovrever,  the 
Third  Fleet  OP-ORDER  and  the  OP-ORDER  that  took  the  30  ships  to 
sea  snd  set  that  thing  into  motion  we  had  pretty  well  defined, 
and  there  were  specific  tasks  in  there. 

Question  : I didn't  mean  it  in  that  kind  of  global  sense,  but 
vhen  it  came  time  to  make  the  decision  you  were  going  to  make. 

If  you  were  going  to  have  soneone  build  programs  and  assist  you 
in  making  decisions,  it  is  not  at  all  clear  which  ones  are  znost 
important  to  you.  It  is  very  difficult  to  get  fron  you  \diich  is 
the  most  important.  The  same  thing  came  up  earlier  before  you 
arrived,  when  General  Creech  was  talking  about  proposals.  He 


said  the  argtments  it  took  to  get  a $12  ndllion  ORFD'C  facility 
established  in  Central  Europe  were  more  difficult  than  getting 
the  $1.5  billion  dollar  aircraft  program  off  the  ground.  I think 
our  experience  with  TFtX  has  been  every  bit  as  prolonged,  and  we 
have  as  yet  to  succeed.  I am  interested  in  how,  after  a year  and 
a half,  since  your  playing  it  fron  the  other  end,  how  do  you  con- 
vince your  own  coimunity  that  12  million  dollars  isn't  all  that 
much  money? 

Kinnear:  I didn't,  I am  still  being  criticized  for  the  project. 
It's  lack  of  appreciation  that  it  was  only  intended  to  demonstrate 
concept,  and  not  to  establish  a hardware  suit  and  that  sort  of 
thing.  I think  that  the  real  valid  point  that  you  made  there  is 
that  the  importance  of  decisions  is  rather  situational.  I don't 
think  you  will  ever  be  able  to  cone  up  with  a real  hierarchy  as 
to  vihich  decision  is  more  important.  There  is  one  thing  that  you 
can  always  hang  up  about  ccmbat.  You  were  talking  about  what 
motivates  people  and  the  military  ccnment  said  that  if  you  hang  a 
ribbon  or  a medal,  or  a little  bit  more  pay,  out  in  front  of  a 
guy,  you  can  get  so  much  motivation.  Maibe  you  could  appeal  to 
his  ego.  That's  great,  but  the  bottom  line  of  contact  is  that 
you  would  like  to  cone  out  of  it  without  swiimiing  if  you  are  in 
the  Navy  and,  of  courst*,  if  you  are  in  an  airplane  you  viould  like 
to  end  up  going  heme  in  the  same  airplane  you  went  out  in.  Basic 
motivatiOTi  — bottom  line  motivation  — is  to  keep  butt  and  soul 
together.  That's  situational  too  tough.  Of  course,  different 
kinds  of  motivaticwi  will  drive  different  kinds  of  people  in  dif- 
ferent kinds  of  situations.  The  hierarchy  of  decision  making, 
and  the  kinds  of  models  you  build,  I don't  think  will  every  be 
very  constant  because  they  are  very  situational.  Like  I said,  I 
am  not  start  enough  to  knew  hew  to  put  that  together,  but  I would 
like  to  t!iink  that,  with  the  gathered  talent  we  have  got  in  this 
roem,  there  is  bound  to  be  seme  real  gain  that  can  be  made.  I 
have  not  been  impressed,  however,  with  the  progress  we  have  made 
in  this  particular  curea.  That's  just  a fact  of  life.  If  I am 
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wrong,  convince  me  of  it  and  I will  apologize.  Otherwise,  you 
have  to  buy  me  a beer. 

(Xiesticyi:  "How  can  we  get  the  operation  to  better  articulate 

as  to  \«hat  sort  of  information  makes  a difference  in  their  deci- 
sion process?  Too  many  of  these  systans,  for  lack  of  that  arti- 
culation, we  collect  everything  we  can  and  try  to  process  it. 

The  result  is  sanevihat  of  a randcm  process  of  supporting  the 
Ccrmander. 

Kinnear:  l-fell,  I can't  give  you  a very  satisfactory  answer.  The 
only  thing  that  I can  say  is  that  building  the  most  flexible  sys- 
tem that  you  can,  so  that  I can  make  it  react  to  the  humans  I 
have  involved  in  the  decision  making  process  and  adaptable  to  the 
circumstances  under  \diich  the  decisions  are  going  to  be  made.  It 
will  have  to  an  interactive  data  base,  and  there  are  a lot  of 
parameters  I can  give  you  on  a data  base.  But  I can't  give  you 
any  pat  answer  to  the  question  you  ask,  because  we  are  dealing 
with  things  that  have  to  do  with  circunstances  and  human  beings. 

I can't  control  either  one  of  those.  It  would  certainly  make 
your  job  easier.  The  only  thing  I can  say  to  you  is  that  you 
will  have  to  build  one  that  is  flexible  enough  that  it  can  be 
used  with  any  gathering  of  decision  makers  who  may  be  given  the 
opporrtunity  or  forced  to  use  that  systan.  It  is  going  to  have 
to  satisfy  every  possible  circimstance  under  V(hich  those  deci- 
sions might  be  made.  That  is  a big  order.  I recognize  it,  but 
I can't  diminish  it  because  that  is  just  the  way  it  is." 
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II.  TECHNICAL  PAPERS 
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Dr.  Miller's  talk  was  based  on  a chapter  In  his  forth- 
coming book.  Living  Systems.  McGraw-Hill,  1977.  This 
chapter  appeared  under  the  title,  "The  Nature  of  Liv- 
ing Systems,"  in  Behavioral  Science.  Vol . 21,  1976, 
pp.  295-319.  We  give  here  three  tables  from  another 
of  his  papers  ["Second  Annual  Ludwig  von  Bertalanffy 
Memorial ,"  Behavioral  Science . Vol.  21  , 1976,  pp.  219- 
277]  which  may  help  the  reader  to  follow  the  discus- 
sion on  the  talk. 

TABLE  I 

The  Critical  Subsystems 

Which  Frucifat  B»ih  Matlrr-Knrr/i^  anj  ln/>,rn,alion 

1 producer,  »hjch  »»  rapabi*-  of  lo  othi-r  ".vMems  umiUr  lu  lh««  one  il  .t.  in 

2 Ih.  .1  ih.  p.r.m.ln  .f  . ...i.n,  ,h.i  hold,  i.ih.ih..  ih.  comp.n.nl.  whi.h  mak,  up  ih,  .y.i.m.  ihum  fro. 

rn\ironm»'n»al  jnd  encluder.  or  permit,  entry  to  vatinui-  M.rii.  of  matter  etiergy  and  inlormalion 


Mnllcr  Enrrii\  Frxtcc^Kinn  Sub.vkfem-. 

3 Inututor.  the  nubcv.iem  which  bnnd'  matter  erier|{>  aernw  the 
»>Mem  boundar\  from  the  environment 


lnf->rmati‘in  Fnm-ri.>,inK  Suhty^lents 

It  input  TrontJurrr  the  i>enM>r>  fub.yxtem  which  hnngn 
markerv  N'arin^  informalion  into  the  chanicmn  them 

to  other  nialter  enerfO  form.,  .uitable  for  trannmiorion  within 
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4 Dutrihulnr.  the  «uVM>«tem  which  carrie»  inpuU  from  oul.«ide 
the  iiyiitem  or  outpuU  from  itn  mi hitv stems  amund  the  system  lo 
each  component 

5 Coni-rrirr.  the  «uh.ystem  which  changes  certain  input.,  to  the 
system  into  formii  more  useful  for  the  special  proces.->es  of  that 
particular  sy.iem 

® P'"<iuirr  the  subsystem  which  forms  .table  association*,  that 
endure  lor  «i|;n*ricani  periods  amoni;  matler-enertcv  input,  to 
the  system  or  outputs  from  its  converter,  the  muteriak  synthe- 
•iced  bein^  f.ir  growth,  damage  repair,  or  replacement  of  com- 
ponents of  the  system,  or  for  providing  energy  for  moving  or 
constituting  the  .y»tem'«  outputs  of  product,  or  information 
marker,  to  its  .uprasystem 

7 Miiticr-fnrrgy  ctorogc.  the  subsystem  which  retain.,  in  the  sys- 
tem. for  different  periods  of  lime,  deposits  o|  various  sort,  of 
matter-energy 

Mallrr  Energy  Pmccrting  Su'my»tefn% 


* Extruder  the  subsystem  which  transmits  matter  energy  nut  \ 
of  the  system  in  the  forms  of  product*  or  wastes  I 

9 Mft'ir  the  subsystem  which  moves  the  system  or  parts  of  it  > 
in  relation  to  part  or  all  of  its  environment  ot  moves  tompo  I 
nenl.  of  its  environment  in  relation  to  each  other  / 

10  .Supporter  the  subsystem  which  maintains  the  proper  spatial 
relationship,  among  components  of  the  system  <u)  that  they 
can  interact  without  weighting  each  other  down  or  crowding 


12  Internal  transducer  the  sensory  subsystem  which  receives, 
from  subsystem,  or  cumponi-nt.  within  the  system,  marker, 
hearing  mhirmation  about  significant  alterations  in  those  sub 
system,  or  cumponents.  changing  them  to  other  matter-energy 
form,  of  a sort  which  can  he  transmitted  withm  it 

13  Channel  and  net.  the  subsystem  composed  of  a single  route  in 
physical  space,  or  multiple  interconnected  routes,  by  which 
markers  bearing  information  are  transmitted  to  all  part,  of  the 
system 

14  Decoder,  the  si  b.ystem  which  alter*  the  code  of  inhirmalion 
input  to  It  through  the  input  transducer  or  iniemat  trinudurer 
into  a "private  " code  that  can  lie  used  internally  by  the  system 

15  A...v<ir(ar<>r,  the  subsystem  which  carries  out  the  first  stage  of 
the  learning  process,  forming  enduring  association,  among 
Items  of  information  in  the  system 


Mefnnrv  the  .uhsystem  which  carries  o 
the  learning  process,  .toring  various  sort 
system  for  different  periods  of  lime 


It  the  second  stage  of 
' of  information  in  the 


Informalinn  Processing  Suhsyntenis 
17  Decider,  the  eseculive  subsystem  which  receives  informatton 
inputs  from  all  other  subsystem,  and  transmit,  to  them  infor 
miition  outputs  that  control  the  entire  <y.iem 
Encttder  the  subsystem  which  alters  the  code  of  information 
input  lo  It  from  other  information  processing  subsystems,  from 
a "'private'  code  used  internally  bv  the  system  into  a " public" 
code  which  can  he  inierpreied  by  other  system,  in  its  environ- 
ment 

19  (iutput  trunsdurer  the  suKsvstem  which  puts  out  m.irkers 
hearing  information  from  the  system,  changing  markers 
within  the  system  int<i other  matter  energy  form,  which  can  Ive 
transmuted  over  channels  m the  system  s environment 
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TABLE  2 

Selec  TED  Major  Components  op  Each  op  19  Critical  Subsystems  at  Each  of  Seven  Levels  op  Living 
Systems.  The  Components  op  Seven  Subsystems.  Identipied  by  •.  Are  as  Yet  Unknown 


LIVCL 


Nl’MtSTKM 

<vii 

' 

Organ 

Organism 

Group 

Organization 

Society 

Supranational 

SysU-m 

3 S 1 Krpro^ 
dutrr  >Hri 

(hroniiKMHne 

none,  down- 
wardly dis- 

persed to  cell 
level 

genitalia 



mating  dyad 

group  that  pne 
duces  a 

charter  for  an 
organization 

cunadluiional 

convention 

■ ■ ' 1 

supranational 
system  which 
creates  an- 

other supran- 
ational sys- 

3 i 'i  H<>urHLir\ 

cell  membrane 

capsule  of  viiirus 

skin 

sergeant-at- 

arms 

guard  of  an  or- 
ganizations 
property 

organization  of 
border  guards 

supranational 

‘irgamzatiun 

of  bordef 
guards 

3 2 1 Inip'iiifr 
■IN 

gap  in  cell  mem- 
brane 

input  artery  of 
organ 

mouth 

refreshment 

chairman 

receiving  de- 
partment 

import  company 

supranational 
system  c«>m- 
ponent  that 
admits  new 
members 

3 2 2 [>i»lnb- 
ut<ir  Dll 

endi>pls!tmK  re- 
ticulum 

blieal  vesaels  'if 

..rgan 

Vascular  system 

mother  who 

passes  out 
food  to  family 

driver 

transportation 

company 

UNICEF,  which 

distributes 
f(K>d  to  needy 
children 

3 2 3 I'lmvrrtrr 
iCOt 

enzvme  in  mito- 
chondrion 

pareiH'hymel 

cell 

upper  gastroin- 
testinal tract 

butcher 

oil  refinery  op- 
erating group 

oil  refinery 

EURATOM. 

concerned  < 

with  conver- 
sion of  atomic 
energy 

3.2.4  Producer 
iPR' 

enxyme  in  mito- 
chondrion 

parenchymel 

cell 

unknown* 

cook 

factory  pnxluc- 
tiun  unit 

factory- 

World  Health 

Organization 

.WHO.  . 

3.2.5  Matter- 

adenixiine  tri- 

intercellular 

fatty  tissues 

family  member 

stork  room  oper- 

warehouse corn- 

International 

Energy  Stt>r- 
age  *MS> 

phosphate 

lATPi 

fluid 

who  stores 
food 

ating  group 

Red  Cross, 
which  stores 

materials  for 

disaster  relief 

3.2  6 Extruder 
iEX> 

gap  in  cell  mem- 
brane 

output  vein  of 
organ 

urethra 

cleaning  woman 

delivery  depart- 
ment 

export  company 

component  of 

IAEA  con- 
cerned with 

waste  extru- 
sion 

3 2 7 Motor 
iMOi 

microtubule 

mu.scle  tissue  of 

organ 

muscle  of  legs 

none;  laterally 
dispersed  to 
all  members 
of  group  who 
move  jointly 

crew  of  machine 

that  moves  or- 
ganization 
personnel 

trucking  com- 
pany 

transport  com- 
ponent of 

NATO 

3 2 8 Supporter 
<SUt 

microtubule 

stroma 

skeleton 

person  who 
physically 
supports  oth- 
ers in  group 

building 

public  building 
and  land 

United  Nations 
building  and 
land 

3 3 I Input 

specialized  re- 

receptw cell  of 

exteroceptive 

lookout 

telephone  opera- 

foreign news 

news  service 

Tran.idurer 

ceptor  site  o| 
cell  mem- 

brane 

sense  organ 

sense  organ 

tor  group 

service 

that  brings  in- 
formation into 
supranational 
system 

3 3 2 Internal 

repressor  mole- 

specialized cell 

receptor  cell  that 

group  member 

inspection  unit 

public  opinion 

supranational 

Transducer 

uni 

cule 

of  sinoainal 
node  of  heart 

reaponda  to 
changes  in 
blood  states 

who  reports 
group  states 
to  decider 

polling  agency 

inspection  or- 
ganization 

3 3.3  Channel 
and  Net  icni 

cell  membrane 

nerve  net  of  or- 

gan 

neural  network 

group  member 
who  commu- 
nicates to 

other  mem- 
bers 

private  tele- 
phone ex- 
change 

national  tele- 
phone net- 
work 

UniverMl 

P.Mtal  Union 

3 3 4 Decoder 

molecular  bind- 

receptor or  sec- 

cell in  sensory 

interpreter 

foregin  lan- 

language trans- 

supranational 

'dCI 

ing  site 

ond-echelon 
cell  of  sense 

organ 

nuclei 

guage  trans- 
lation group 

lation  unit 

language 

translation 

unit 

3 3 5 A-wiciator 

<as> 

unknown* 

unknown* 

unknown* 

none:  laterally 
dispersed  to 
member  who 

associates  for 
groilp 

none:  down- 
wardly dis- 
persed (0  indi- 
vidual per- 
sons. orga- 
nism level 

teaching  insti- 
tution 

. .... 

supranational 
saentific  or- 
ganization 1 

1 
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TABLK  2 —{itntinufd 


1 


I 

i 

I 

II 


LKVtL 


siaavaTkM 

Cell 

Organ 

Organism 

Group 

■“"1 

Organiiatuiii 

Society 

Supranational 

System 

3 3 <>  Meniorv 

unknown* 

unknown* 

unknow n* 

adult  ina  familv 

filing  depart- 

librarv 

United  Nations 

itnei 

ment 

library  ' 

3 3 7 Ihxider 

regulator  gene 

9V7»pathel)>'  fi- 

part of  cerebral 

father  of  a fam- 

executive  office 

government 

Council  of  the 

i<k-< 

ber  of  sinua- 

loTtes 

Kuropean 

trial  niah-  of 

Kcorwimic 

heart 

Community 

3 3 8 Km  Oder 

I'ompunrnl  pixs 

presvnaptu  re- 

temporoparietal 

person  who  com- 

speech  writing 

press  sccretarv 

United  Nations 

leni 

during  hor 

gion  of  output 

area  ii(  domi- 

poM-s a group 

department 

Office  of  Pub- 

m»ne 

neuron  of  or- 

nant hemi- 

statement 

lic  Informa-  • 

gan 

sphere  of  hu- 

tion 

man  brain 

3 3 i*  < lutpui 

prfsvnuptii 

presvnaptu  re- 

lurvnx 

spokesman 

publu  relations 

office  of  national 

spokesman  of 

Transduier 

membrane 

gion  of  output 

department 

spukesnian 

the  office  of 

i»ti 

neuron  of  or- 

Warsaw 

gan 

Treaty  Orga- 

nizatum 

TABLE  3 

Channel  and  Net  Subsystem  at  the  Level  of  the  Organism.  Its  Variables  and  Indicators 

Vur)iihlt>s  Indicaturs 

All  l-rwU  OrKttnism  l^-vel 

•Ch.tnfn*!  and  NVi  Sub>>*Cemi  iChann*-!  and  Nol  Suh>y»U'm.  Neural  I'ompunent*" 

Meaiiink;  <>l  informalion  channeled  to  various  part.>  of  the  M(-a>ure  of  (he  change  of  the  oignal-  (rannmitted  over  a neural  tract  on 

>.v«tein  Ihe  prore>M->  ol  the  organism 


Sorts  III  information  channeled  to  various  parts  of  the  system 

Percentage  of  inlormiition  arriving  at  the  appropriate  re- 
ceiver in  the  channel  and  net 


Freviuencv  range  nr  source  of  infurmaliun  of  transducer  which  inputs 
signal  into  n neural  ir.act 

I’ercentage  of  total  number  of  hits  input  to  a neural  tract  that  are  output 
from  It  in  a specific  period 


Threshold  of  Ihe  channel  and  net 


t'hanges  m ch.innel  and  net  processing  over  lime 


Intensity  of  nulpui  from  another  information  processing  subsystem  re- 
Vfuired  to  input  a signal  over  a neural  tract 
l)ilTerenc«*s  in  meaning.  s<irt,  rale,  distortion,  or  other  aspects  of  signal 
trasnmitled  over  a neural  tract  tx'lween  one  lime  and  another 


Changes  in  channel  and  net  processing  with  different  cir- 

Information  cnpacilv  of  the  channel  and  net 

Distortion  of  the  channel  and  net 

Signal-to-noise  ratio  in  (he  channel  and  net 

Rate  of  processing  of  information  over  the  channel  and  net 

Lag  in  channel  and  net  processing 

Costs  of  channel  and  net  processing 


Differenci’s  in  meaning,  sort.  rate,  distortion,  or  other  aspects  of  signal 
transmitted  over  a neural  tract  between  one  lime  when  one  or  more 
independent  variables  have  one  value  or  set  of  values  and  another  lime 
when  that  value  or  set  of  values  is  different 

Maximum  number  of  bits  per  second  that  can  be  transmitted  over  a neural 
tract 

Amount  of  alteration  in  the  wave  form  or  relationships  between  various 
fre()uenr>  components  of  a signal  transmitted  over  a neural  tract 

The  ratio  in  decibels  between  Ihe  amplitude  of  the  signal  and  the  back- 
ground noise  in  a neural  tract 

Number  of  bits  of  information  transmitted  over  a neural  tract  in  a specific 
second 

Number  of  seconds  between  input  and  output  of  a signal  over  a neural 
tract 

Amount  of  mailer-energy  expended  in  a specific  transmission  of  informa- 
tion over  a particular  neural  tract 
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DISCUSSICN 


Saaty:  I find  the  classif icatioi  of  hierarchy  fascinating  and  I 
wish  to  ask  a question.  I am  curious  about  the  19  conponents  in 
each  level?  Are  these  independent  coiponents  or  do  they  interact 
j;  so  that  they  form  clusters?  Is  perhaps  their  a total  number  of 

snaller?  Bie  reason  for  this  is  that  playing  around  with  ideas 
as  I talked  about  this  morning  - if  you  are  at  a higher  signifi- 
cance level  and  if  you  assume  that  nature  operates  in  a consistent 
fashion,  my  total  number  is  more  between  40  and  50  and  I find  the 
number  of  132  a little  high  and  I was  just  curious  about  it. 
Miller:  Well,  I didn't  decide  on  the  number  of  sul>-systems  - God 
or  Dcuwin  did.  It  seems  to  me  that  they  are  in  3 clusters  which 
I indicated  in  the  3 columns  of  my  basic  chart.  There  is  an  in- 
put out-put  relationship  of  matter  and  energy.  There  is  a flow 
through  sub-systan  which  processes  it  in  various  ways  like  the 
assembly  line.  That  is  one  of  the  clusters  of  sub-systans.  There 
is  in-put,  throughput  and  output  of  information.  That's  the 
processing  that  goes  on  internally  and  that  is  the  second.  There 
is,  as  I pointed  out,  two  functions:  - The  boundary  function  and 
the  reproducing  functioi-that' s involved  in  both.  So  if  I wore 
to  select  a cluster  of  sub  systans  it  would  be  those  3. 

^crte;  You  menticned  an  essential  elanent  of  the  control  systan 
is  a reward  or  penalty.  Can  you  interpret  that  in  terms  of  train- 
ing, loyalty  esprit  de  corps,  things  of  that  sort,  which  many  of 
us  think  about? 

i Miller:  Well,  there  is  a rather  gross  and  base  level,  kncwn  as 

I food  and  money.  You  cannot  continue  any  military  activity  of  any 

I civilian  activity  without  adequate  inputs  of  food  water  and  oxy- 

gen. In  modem  times  we  have  scmething  kncwn  as  legal  tender  or 
I money,  which  can  be  transfered  frcm  one  purpose  or  another  so  you 

can  buy  either  seme  of  those  necessities  or  other  types  of  neces- 
sities or  luxuries  vdth  the  same  money.  So  money  r^resents  the 
opportunity  to  choose  between  various  inputs  you  may  wish  to  have 
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You  have  to  have  that  sort  of  incentive  to  operate  any  system. 

You  have  even  the  love  relationship  between  a mother  and  a child 
that  is  based  on  a input  output  relationhip  primarily  at  the 
beginning.  In  a maturational  species  like  ours  where  the  infant 
is  dependent  for  a period  of  time  on  the  mother  - unlike  chicks 
which  are  not  dependent  in  a precocious  species  like  that  - you 
have  a parasitism  fnxn  the  beginning  in  which  one  individual  is 
dependent  on  another  one  for  certain  inputs  or  outputs  - the 
same  thing  v*>en  you  get  older,  as  an  older  person  in  a nursing 
hone,  you  are  dependent  on  a input  output  function  frcm  the 
groip  - that  is,  the  nursing  group  which  is  taking  care  of  you. 

You  have  a paracitist  situaticai  in  old  age  often  times. 

The  same  thing  is  true  in  military  organizaticxis,  business 
corporations  or  universities  where  ever  it  may  be,  that  a basic 
reward  systems  is  c^jerative.  It  may  be  a reward  for  prorotion  in 
rank,  prcmoticsi  in  salary  or  it  may  be  just  a prcmoticxi  in  pres- 
tige in  status  or  recognition.  This  often  as  we  have  found  out  by 
in  the  fact  that  we  now  give  our  military  all  sorts  of  ribbons  to 
wear  and  so  on,  because  this  apparently  does  effect  motivation  and 
does  effect  recognition,  is  a very  inportant  factor.  Human  beings 

■ 

are  so  built  apparently  that  you  can  get  what  you  call  autonomous 
drives,  learned  drives.  They  are  based  I believe  on  the  basic 
biological  drives  originally  but  if  you  learn  to  be  as  satisfied 
wdth  recognition  - a salute  for  exaitple  as  you  are,  in  a sense, 
with  a piece  of  apple  pie.  Therefore  you  can  get  an  instinctive 
operative,  a systan  operating  and  vre  do  - which  can  get  men  into 
battle  even  death  apparently  walling  or  voluntarily,  in  order  to 
receive  even  posthnnous  rewards  or  recogniticsi  or  in  order  not  to 
be  punished,  which  is,  of  course,  the  negative  side  to  all  of  this. 

There  are  a whole  lot  of  studies  on  reward  and  punishment  which 
indicate  this  is  a very  rough  figure  and  not  reliable  in  any  sense. 

Perhaps  revrard  is  20  times  as  effective  in  notivaticai  behavior  as 
punishment.  So  there  are  2 types  - there  are  the  basic  drives  we 
call  biological  and  social  drives  and  then  there  are  the  learned 
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drives  and  they  are  both  effective  in  motivating  behavior  and 
could  be  used  and  are  used  in  any  living  system  that  I know  of. 

I wish  we  could  get  one  question  on  the  tcpic  of  this  con- 
ference. Given  another  hour  I could  talk  about  what  we  are  here 
for. 

Leharann:  You  know  I think  you  have  hit  the  mark.  I don't  think 
people  are  wanting  for  a lack  of  ideas  on  how  you  applied  this 
to  Tactical  Ccftitand  and  Control. 

(Xiestion:  I wonder  if  you  have  ar^  exaiiple  of  a specific  systan 
which  is  scmevihat  related  to  this  groins  which  you  could  cite 
which  has  been  tried  or  applied? 

Miller:  Well  yes,  ws  have  in  our  graduate  program  at  the  Univer- 
sity of  Louisville  a general  exercise  that  our  master's  level  stu- 
dent go  through,  like  an  early  exercise  that  is  applied  on  a con- 
ceptional  approach.  We  assign  to  them  an  organization  and  say, 

"Go  out  and  study  it.  Get  a map  of  it  in  space  - a regular  map  - 
and  draw  on  it  in  different  colors  the  19  sub  systare  and  cone 
back  vhen  you  have  been  able  to  do  it  and  write  a papier  defending 
your  break-down  of  our  universe  into  the  19  sub  systems." 

They  do  that  and  then  they  go  on  to  the  next  step  and  ve  say, 
"Which  of  these  is  the  systan  total  potential?"  That's  another 
technical  term  we  use  that  I didn't  use  that  is,  corpletely  inde- 
piendent.  For  exaitple:  Astronauts  in  space  have  to  be  totally 
potential  - they  have  to  have  all  capability  of  life  with  them. 

But  we  are  not  totally  potential  here,  for  exanple.  This  groip, 
as  long  as  it  is  in  Airlie  House,  is  dependent  for  matter  inputs 
and  outputs  , fortunately,  on  the  Airlie  House  hospitality,  so 
we  are  not  a totally  potential  group.  You  have  to  identify  to 
what  extent  this  particular  system  you  are  looking  at  is  depen- 
dent on  the  intrastructure  of  the  society  of  which  it  is  depen- 
dent. If  you  closed  off  its  boundries,  in  other  words,  how  long 
vrould  it  be  able  to  continue  to  live.  Sate  of  them  might  consider 
!few  York  would  terminate  over  night  because  it  is  so  un-potential, 
the  c^^site  of  total  potential,  that  closing  its  boundries  for  24 
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hours  would  cause  fantastic  disturbance.  On  the  other  hand  you 
take  a primitive  town  say  in  far  out  Turkey.  - You  could  put  a 
seige  on  that  and  it  might  be  able  to  continue  for  a year.  So 
you  have  analyses  of  this  sort  which  you  can  irake  - vrtiich  we  do 
make  as  early  exercises  in  our  advance  classes  - which  are  appli- 
cations to  types  of  problans  I think  seme  you  you  are  interested 
in.  Thcink  you. 


INTERACTION  AND  IMPACTS  IN 
HIERARCHICAL  SYSTEMS 

Thomas  L.  Saaty 
University  of  Pennsylvania 


1.0  IntAodacZLon.  The  scientific  literature  of  hier- 
archies has  driven  home  to  physical,  behavioral  and 
rystems  scientists  and  particularly  to  people  interested 
in  organization  theory,  the  lesson  that  a hierarchy  is 
he  single  most  powerful  mental  construct  for  studying 
complex  systems.  Whether  one  is  simply  interested  in 
understanding  the  actual  structure  and  flow  of  a system 
or  whether  he  is  concerned  with  the  functional  inter- 
actions of  its  components,  a hierarchical  model  of  that 
system  must  inevitably  be  examined.  Hierarchic  organi- 
zation is  crucial  to  the  synthesis  and  survival  of 
large  systems.  Hierarchic  systems  have  common  prop- 
erties that  are  independent  of  their  specific  content. 

There  are  several  kinds  of  hierarchies,  the 
simplest  of  which  are  dominance  hierarchies  which 
descend  like  an  inverted  tree  with  the  boss  at  the  root, 
followed  by  successive  levels  of  bossing.  Another  kind 
are  holarchies  which  are  essentially  dominance  hier- 
archies with  feedback.  Chinese  box  (or  modular)  hier- 
archies grow  in  size  from  the  simplest  elements  or  com- 
ponents (the  inner  boxes)  to  larger  and  larger  aggre- 
gates (the  outer  boxes) . In  biology,  neogenetic  hier- 
archies are  of  interest  because  they  have  successive 
newly  emerging  top  levels  through  evolution.  We  shall 
concentrate  our  attention  on  dominance  hierarchies, 
although  the  theory  described  below  is  being  generalized 
to  the  other  hierarchical  forms. 


Even  if  the  structure  of  a system  is  character- 
ized by  a network  of  a high  dimension  of  complexity, 
when  it  is  analyzed  according  to  function  and  purpose, 
it  takes  on  the  simple  form  of  a dominance  hierarchy 
with  descending  levels  of  decreasing  importance. 

What  interests  us  here  is  to  provide  an  in- 
formal report  on  research  leading  to  a useful  theory 
for  analyzing  the  impacts  of  different  levels, 
representing  subsystems,  of  a system,  characterized  as 
a hierarchy,  on  the  entire  hierarchy  and  conversely. 

The  theory  also  enables  us  to  study  the  stability  of 
a hierarchy  to  perturbations  in  both  structure  and 
function. 

The  development  of  the  theory  has  called  for  a 
new  and  general  method  of  measurement  yielding  ratio 
scales.  This  method  has  been  successfully  tested  by 
way  of  validation  in  optics,  heat  and  similar  phenomena. 
It  has  also  been  applied  in  economics  to  estimate  the 
relative  wealth  of  nations  (correlating  closely  with 
their  GNP's)  and  in  politics  to  determine  a measure  of 
influence  of  nations. 

An  intrinsic  useful  by-product  of  the  theory 
is  an  index  of  consistency  which  provides  information 
on  how  serious  are  violations  of  numerical  (cardinal) 
and  transitive  (ordinal)  consistency.  The  result 
could  be  to  seek  additional  information  and  reexamine 
the  data  used  in  constructing  the  scale  in  order  to 
improve  consistency.  Such  an  index  is  not  available 
in  other  procedures  for  the  construction  of  ratio 
scales.  The  method  also  utilizes,  for  reasons  sug- 
gested by  consistency  requirements,  reciprocal  entries 
(a^^  = 1/a^ j ) in  pairwise  comparison  matrices  instead 

of  the  traditional  a^^  = "Sj^j  used  for  construction  of 
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interval  scales.  This  is  both  an  intuitively  reason- 
able assumption  and  turns  out  to  be  an  asset  in  using 
the  basic  theory  of  Perron-Frobenius  to  establish  the 
existence  of  a non-negative  unique  rolution  as  a ratio 
scale . 

Our  approach  reduces  to  thi;  .tudy  of  two 
related  problems:  The  first  is  concerned  with  measure- 
ment. Suppose  we  are  given  a set  of  objects  which  are 
all  sufficiently  light  and  can  be  lifted  by  hand.  We 
wish  to  estimate  their  relative  weights.  One  way  would 
be  to  directly  guess  the  weight  of  each  object  in  pounds 
for  example,  by  lifting  it  (perhaps  using  the  lightest 
one  as  the  standard),  comparing  the  whole  class,  and 
then  dividing  the  weight  of  each  by  the  total  to  get 
its  relative  weight.  Another  method  which  utilizes 
more  of  the  available  information  in  the  experiment  is 
to  compare  the  objects  in  pairs,  such  as  lifting  one 
and  then  lifting  another  and  then  back  to  the  first 
and  then  again  the  second  and  so  on  until  we  have 
formulated  a judgment  as  to  the  relative  weight  (ratio) 
of  each  pair  of  objects.  The  problem  then  is  to  find 
these  pairwise  comparisons.  There  is  such  a way  and 
it  will  be  discussed  in  detail  later.  The  second 
process  has  the  advantage  of  focusing  on  two  objects 
at  a time  and  on  how  they  relate  to  each  other.  It 
also  uses  redundant  information  since  each  object  is 
methodically  compared  with  every  other. 

For  problems  where  there  is  no  scale  to  vali- 
date the  result,  the  pairwise  comparison  process  can 
prove  to  be  an  asset  because  in  a sense  it  is  simpler 
in  each  of  its  steps  than  the  first. 

All  measurement  including  those  which  make  use 
of  instruments  are  subject  to  experimental  error  and 
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to  error  in  the  measuring  instrument.  A ser’ous  effect 
of  error  is  that  it  can  and  often  does  lead  to  incon- 
sistent conclusions.  A simple  example  of  the  conse- 
quence of  error  in  weighing  objects  is  to  find  that  A 
is  heavier  than  B,  and  B is  heavier  than  C but  C is 
heavier  than  A.  This  can  happen  particularly  when  the 
weights  of  A,  B,  and  C are  close,  and  the  instrument 
is  not  fine  enough  to  distinguish  between  them.  Lack 
of  consistency  may  be  serious  for  some  problems  but 
not  for  others.  For  example,  if  the  objects  are  two 
chemicals  to  be  mixed  together  in  exact  proportion  to 
make  a drug,  inconsistency  may  mean  that  proportionately 
more  of  one  chemical  is  used  than  the  other  possibly 
leading  to  harmful  results  in  using  the  drug. 

But  perfect  consistency  in  measurement  even 
with  the  finest  instruments  is  difficult  to  attain  in 
practice  and  what  we  need  is  a way  of  evaluating  how 
bad  it  is  for  a particular  problem. 

Since  consistency  is  a central  question  in 
concrete  measurement,  in  judgments,  and  in  the  thinking 
process,  an  effective  measure  of  consistency  in  apply- 
ing numerical  ratio  scales,  is  an  incentive  for 
developing  scales  in  areas  where  we  do  not  have  in- 
struments of  measurement.  In  passing  we  note  that 
measuring  instruments  are  not  land  cannot  be  means  of 
absolute  measurement  but  themselves  have  been  the 
object  of  scientific  research.  If  these  instru.nents 
are  for  any  reason  inadequate  (and  one  can  always 
devise  an  experiment  for  which  there  is  no  satisfactory 
instrument  for  measurement)  then  we  must  keep  inventing 
new  instruments.  It  is  not  difficult  to  imagine  some 
important  experiment  for  which  no  sufficiently  fine 
instrument  can  ever  be  found  from  which  consistent 
answers  can  always  be  obtained.  In  that  case  the 
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entire  problem  is  shifted  to  the  study  of  consistency 
and  evaluating  the  seriousness  of  inconsistency. 

The  process  of  measurement  by  pairwise  compari- 
sons leads  in  a natural  way  to  the  problem  of  consist- 
ency, enabling  us  to  characterize  or  say  exactly  what 
we  mean  by  consistency,  and  to  develop  a measure  for 
how  serious  inconsistency  is. 

In  the  measurement  of  physical  quantities  it 
is  usually  possible  to  set  down  a dimension  or  property 
such  as  length  which  remains  the  same  (relativity  not- 
withstanding) in  time  and  space  and  devise  instruments 
to  measure  this  property.  Naturally  it  would  be  more 
difficult  to  make  an  instrument  which  adjusts  its  scale 
to  changing  circumstances  before  doing  measurement. 

For  example,  length  and  mass  vary  at  speeds  near  that 
of  light  and  an  instrument  that  directly  measured  these 
properties  at  near  the  speed  of  light  would  require 
some  kind  of  variable  scale. 

This  is  precisely  the  problem  in  the  social 
sciences.  When  we  deal  with  properties  that  change  not 
only  in  time  and  space  but  also,  (and  far  more  serious- 
ly) in  conjunction  with  other  properties,  their  meaning 
also  changes.  We  cannot  improvise  universal  scales  for 
social  events.  Social  phenomena  are  even  more  compli- 
cated than  physical  phenomena  because  they  are  harder 
to  replicate  in  abundance.  Too  much  control  must  be 
imposed  and  controls  in  themselves  often  destroy  the 
very  social  behavior  one  is  trying  to  measure.  Our 
judgments  must  be  sufficiently  flexible  to  take  into 
consideration  the  contextual  setting  of  the  property 
being  measured. 

Consider  the  problem  of  measuring  achievement 
and  happiness.  Both  may  be  called  relative  properties 
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in  that  the  unit  of  measurement  may  have  to  be  ad- 
justed to  compare,  for  example,  the  degree  of  happiness 
in  one  setting  with  that  in  another  and  as  we  shall 
see  it  is  possible  to  do  this  with  the  pairwise  com- 
parison technique.  What  we  need  to  recognize  is  that 
an  instrument  which  varies  its  scale  with  the  rela- 
tiveness of  the  circumstance  can  be  the  human  mind 
itself,  particularly,  if  it  turns  out  that  its  measure- 
ment is  sufficiently  consistent  to  satisfy  the  require- 
ments of  the  particular  problem.  The  intensity  of  our 
feelings  serves  as  a scale-adjustment-device  to  put 
the  measurement  of  some  objects  on  a commensurate 
scale  with  that  of  other  objects.  In  fact  as  the  mind 
improves  its  precision  it  becomes  the  required  tool 
for  relative  measurement  as  no  instrument  except  our 
very  personally  designed  one  (our  own  mind)  can  be  made 
to  suit  our  particular  experience  and  viewpoint.  A 
group  must  coordinate  their  outloo)c  to  produce  results 
acceptable  (in  some  sense)  to  them. 

But  the  problem  does  not  end  here.  By  way  of 
validation  whatever  method  of  scaling  we  develop  must 
so  far  as  it  is  possible,  reproduce  results  consistent 
with  those  Vcnown  in  physical  and  in  any  other  area 
where  there  are  scales  for  measurement.  This  should 
serve  to  encourage  extending  the  method  to  the  "softer" 
areas  of  the  social  sciences. 

We  now  turn  to  our  second  problem  which  is 
concerned  with  providing  greater  stability  and  invari- 
ance to  social  measurement.  Granted  that  the  dimen- 
sions or  properties  are  variable  how  do  we  measure  the 
impact  of  this  variability  on  still  other  higher  level 
properties,  and  in  turn  these  on  still  higher  ones. 

It  turns  out  that  for  a very  wide  class  of  problems 
we  can  usually  identify  overall  properties  (or  one 
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property)  which  remain  the  same  for  sufficiently  long 
duration  of  an  experiment.  This  approach  leads  us  to 
the  measurement  and  analysis  of  impacts  in  hierarchies. 

The  theory  of  hierarchies  says  that  complex 
systems  problems  are  hierarchic  in  nature  with  their 
elements  occupying  different  levels  of  the  hierarchy 
and  that  we  can  study  the  contributions  or  impacts  of 
these  elements  on  the  hierarchy  through  the  use  of 
measurement.  We  can  also  study  the  invariance  of  the 
measurement  by  changing  the  levels  of  the  hierarchy. 

The  results  of  the  measurement  may  be  used  to  enhance 
the  stability  of  the  system  or  to  design  new  goal- 
oriented  systems.  They  can  also  be  used  (as  priori- 
ties) to  allocate  resources. 

As  we  said  before,  the  theory  of  hierarchies 
provides  models  for  studying  interactions  between 
elements  and  components  (levels)  of  a system.  The 
assumption  here  is  that  measurement  derives  from  judg- 
ments based  on  observation  and  understanding.  These 
observations  enable  measurement  from  comparisons  (not 
from  absolutes) . And  also  the  comparisons  result  in 
separating  objects  or  phenomena  into  comparability 
classes  which  are  levels  of  the  hierarchy.  Measurement 
is  used  to  study  interactions  among  comparability 
classes.  Furthermore  the  objects  in  any  class  are 
compared  according  to  their  impact  on  each  element  of 
the  immediately  higher  level.  This  is  equivalent  to 
measuring  how  strongly  each  element  possesses  a prop- 
erty or  attribute  belonging  to  a different  level.  For 
each  property  the  comparison  shows  the  relative 
strength  of  an  object  or  property  (as  a generic  term) 
in  a level.  The  hierarchical  structure  makes  it  pos- 
sible to  perpetrate  the  impact  study  up  and  down  the 
hierarchy. 
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Since  1971  about  thirty  applications  have  been 
made  of  the  theory  of  hierarchies  ranging  from  energy 
studies  for  the  government  to  designing  a transport 
system  for  the  Sudan  and  to  planning  with  the  board  of 
a corporation  towards  more  desirable  futures.  Let  us 
now  turn  to  a few  elementary  examples  to  illustrate 
the  basic  ideas. 

2.0  Mea6^/lenleJ^t.  It  is  inevitable,  in  the  study  of 
hierarchies,  that  the  problem  of  measurement  should 
arise.  If  we  are  interested  in  measuring  the  impact 
of  a set  of  elements  in  a level  of  the  hierarchy  on 
each  of  the  elements  of  the  next  higher  level,  we  must 
be  able  to  measure  the  behavior  of  the  elements  or 
their  contribution  to  the  elements  of  the  higher  level. 
Here  we  need  to  recognize  that  all  measurement  which 
leads  to  a standard  scale  must  begin  with  observation; 
in  fact,  many  observations.  When  the  measurement 
derives  from  preferences  based  on  abstract  knowledge 
or  feeling,  the  latter  must  serve  in  some  reliable 
fashion  the  role  of  direct  observation.  Thus,  our 
analytical  approach  must  have  an  appeal  to  a wide 
variety  of  needs  in  measurement.  Its  validation  in 
areas  where  measurement  is  available  would  serve  to 
increase  confidence  in  its  use  in  new  areas. 

It  is  clear  that  in  order  to  develop  a scale 
of  measurement  we  must  learn  to  compare.  With  com- 
parison there  is  associated  a relative  scale  for  the 
objects  being  compared.  When  a sufficiently  large 
number  of  objects  has  been  considered  in  the  comparison 
process  and  analytical  or  judgmental  agreement  reached 
on  the  values  in  the  comparison,  the  resulting  scale 
acquires  greater  universality  and  autonomy. 

We  distinguish  between  objects  or  between 
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phenomena  because  they  have  different  properties  or 
occupy  different  positions  in  space  and  time.  The 
distinction  is  usually  made  with  respect  to  several 
properties  at  the  same  time.  In  fact,  we  need  to  know 
the  relative  standing  of  each  object  according  to  all 

the  properties;  we  must  distinguish  between  the  prop-  ^ 

erties  themselves.  This  process  of  distinguishing 
between  things  is  a process  of  comparison.  If  the 
objects  are  independent,  all  comparisons  can  be  reduced 

to  pairwise  comparisons.  If  they  are  dependent,  then  j 

the  dependence  itself  must  be  taken  into  consideration 

in  the  final  weighting.  | 

When  we  are  interested  in  causal  explanation,  i 

we  find  that  phenomena  can  be  arranged  according  to  | 

precedence:  something  must  happen  before  something  j 

else  can  happen.  Ordering  leads  to  hierarchical  type 

of  structures  in  which  first  causes  occupy  higher  j 

levels  of  the  hierarchy. 

The  ordering  is  a first  step  in  the  process  of 
measuring  variations  among  the  objects  being  compared  i 

according  to  each  of  several  properties.  What  is 

usually  desired  is  stronger  than  simple  order.  In  ' 

scientific  measurement  more  often  than  not  we  seek 

measurement  on  ratio  scales.  This  is  what  we  will  < 

discuss  here. 

When  we  deal  with  phenomena  for  which  there  are 
no  known  or  widely  agreed  upon  scales  and  instruments 
of  measurement,  it  becomes  a matter  of  judgment  to 
estimate  numerical  values  for  comparison.  As  more 
people  interact  and  agree  on  these  judgments,  a scale 
(implicit  or  explicit)  gradually  evolves  and  eventu- 
ally acquires  universality.  Examples  are  our  scales 
for  measuring  distance,  time,  weight  and  economic 
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value.  In  some  areas  of  social  interaction  it  is  use- 
ful to  expedite  the  process  of  measurement  by  making 
available  fundamental  tools  which  by  way  of  validation 
yield  the  same  results  in  areas  where  measurement  is 
already  available. 

Works  on  scaling  abound.  The  results  on  ratio 
scales  are  more  scarce.  Among  them  we  have  found 
interesting  accounts  by  S.S.  Stevens  [17],  Churchman 
and  Ratoosh  12],  Torgerson  [19],  Shepard  [14],  and 
Krantz  [4] . 

We  focus  attention  on  a single  level  of  a hier- 
archy and  first  study  the  relation  of  dominance  of  its 
elements  with  respect  to  a single  property.  We  will 
then  study  the  more  general  problem  of  the  impact  of 
all  elements  of  a level  on  the  entire  hierarchy.  We 
have  already  alluded  in  the  introduction  to  a large 
number  of  other  results  and  interactions  which  can  be 
studied  this  way.  It  seems  adequate  to  me  to  only  show 
how  this  fundamental  step  can  be  carried  out.  What  we 
will  do  here  is  to  motivate  the  method  of  generating  a 
ratio  scale  from  pairwise  comparisons  and  generalize 
the  result  to  a hierarchy.  The  full  justification  of 
the  approach  is  found  in  a technical  paper  appearing 
elsewhere . 

3.0  Tke  PaAacUqm  Ca6e  Coni-Litmui.  Assume  that  n activities 
are  being  considered  by  a group  of  interested  people. 

We  assume  that  the  group's  goals  are: 

a.  to  provide  judgments  on  the  relative 
importance  of  these  activities; 

b.  to  insure  that  the  judgments  are  quantified 
to  an  extent  which  also  permits  a quantita- 
tive interpretation  of  the  judgments  among 
all  activities. 
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Clearly,  goal  b will  require  appropriate  technical 
assistance . 

Our  goal  is  to  describe  a method  for  deriving, 
from  the  group's  quantified  judgments  (i.e.,  from  the 
relative  values  associated  with  pairs  of  activities), 
a set  of  weights  to  be  associated  with  individual 
activities;  in  a sense  defined  below,  these  weights 
should  reflect  the  group's  quantified  judgments.  What 
this  approach  achieves  is  to  put  the  information 
resulting  from  a and  b into  usable  form  without 
deleting  information  residing  in  the  qualitative  judg- 
ments . 

Let  C^,  C21  ■■-I  be  the  set  of  activities. 

The  quantified  judgments  on  pairs  of  objectives 
are  represented  by  an  n-by-n  matrix 

A = (a^j)  f (i,  j = 1,  2,  . . . , n)  . 

Having  recorded  the  quantified  judgments  on 
pairs  (C.,  C.)  as  numerical  entries  a. . in  the  matrix 

A,  the  problem  now  is  to  assign  to  the  n contingencies 

C.,  C_,  ...,  C a set  of  numerical  weights 
1 2 n 

w^ , W2 , . . . , w^  that  would  "reflect  the  recorded  judg- 
ments. " 

In  order  to  do  so,  the  vaguely  formulated 
problem  must  first  be  transformed  into  a precise 
mathematical  one.  This  essential,  and  apparently  harm- 
less step,  is  the  most  crucial  one  in  any  problem  that 
requires  the  representation  of  a real-life  situation 
in  terms  of  an  abstract  mathematical  structure.  It  is 
particularly  crucial  in  the  present  problem  where  the 
representation  involves  a number  of  transitions  that 
are  not  immediately  discernible.  It  appears,  there- 
fore, desirable  in  the  present  problem  to  identify  the 
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major  steps  in  the  process  of  representation  and  to 
make  each  step  as  explicit  as  possible  in  order  to 
enable  the  potential  user  to  form  his  own  judgment  on 
the  meaning  and  value  of  the  method  in  relation  to  his 
problem  and  his  goal. 

It  is  convenient  to  first  get  a simple  question 
out  of  the  way.  The  matrix  A of  quantified  judgments 
a^j  may  have  several,  or  only  few,  non-zero  entries. 

The  question  arises:  how  many  non-zero  entries  (i.e., 
how  many  quantifiable  judgments)  are  necessary  in  order 
to  insure  the  existence  of  a set  of  weights  that  is 
meaningful  in  the  context  of  the  problem?  The  obvious 
answer  is:  it  is  necessary  that  there  be  a set  of  non- 
zero entries  that  interconnects  all  activities  in  the 
sense  that  for  every  two  indices,  i,  j,  there  should  be 
some  chain  of  non-zero  entries  connecting  i with  j : 


a . . , 

^2^3 


(3.0) 


When  a^j  0,  a^^^  itself  is  such  a chain  of  length  1. 

(Such  a matrix  A = (a^j)  corresponds  to  what  is  known 
as  a strongly  connected  graph.)  This  gives  precise 
content  to  the  formulation  of  goal  b. 

The  major  question  is  the  one  concerned  with 
the  meaning  of  the  vaguely  formulated  condition  in  the 
statement  of  our  goal:  ..."these  weights  should  reflect 
the  group's  quantified  judgments."  This  presents  the 
need  to  describe  in  precise,  arithmetic  terms,  how  the 
weights  w^  should  relate  to  the  judgments  a^j,'  or,  in 
other  words,  the  problem  of  specifying  the  conditions 
we  wish  to  impose  on  the  weights  we  seek  in  relation  to 
the  judgments  obtained.  The  desired  description  is 
developed  in  3 steps,  proceeding  from  the  simplest 
special  case  to  the  general  one. 
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Assume  first  that  the  "judgments"  are  merely 
the  result  of  precise  physical  measurements.  Say  the 


judges  are  given  a set  of  pebbles,  C^,  C2, 


C and 
n 


a precision  scale.  To  compare  with  C2 , they  put 

on  a scale  and  read  off  its  weight — say,  w^^  = 305  grams. 
They  weigh  and  find  W2  = 244  grams.  They  divide 
Wj^  by  W2 , which  is  1.25.  They  pronounce  their  judgment. 


is  1.25  times  as  heavy  as  C2"  and  record  it  as 


= 1.25.  Thus,  in  this  ideal  case  of  exact  measure- 


ment, the  relations  between  the  weights  w^  and  the 


judgments  a^ . are  simply  given  by: 


= a. . (for  i,  j = 1,  2,  ...,  n) 
w.  13 


(3.1) 


or  by 


a . . w . 

^3.  J = 

w . 

1 


i.  j = 1, 


from  which  we  have  the  fact  that  w^  may  be  obtained  as 
an  average  over  ''' 

write  in  the  form 


a.  w ) which  we 
in  n 


n 

I 


j = l 


a . . w . /w  • = n 
13  j'  1 


i = 1, 


(3.2) 


indicating  that  all  such  ratios  have  the  same  value  n. 

In  matrix  notation  our  problem  taltes  the  form 


Aw  = nw 


(3.3) 


This  is  an  eigenvalue  problem  which  may  be  interpreted 
as  follows:  Given  the  linear  transformation  A,  find 
the  weight  vector  w such  that  it  is  a fixed  point  under 


— A or  simply  that  it  is  dilated  by  a factor  n under  A. 


It  is  worthwhile  investigating  the  properties 
of  matrix  A and  whether  the  problem  (3.3)  has  a unique 
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solution  w with  nonnegative  entries  w^ . Thus  it  would 
be  useful  to  examine  the  paradigm  case  in  greater  depth. 

Let  us  first  note  that  the  matrix  A has  the 
property  that  each  of  its  rows  can  be  generated  from 
any  one  of  them  by  multiplying  by  a different  constant. 
It  follows  that  the  rank  of  A is  unity.  This  observa- 
tion, together  with  the  fact  that  the  main  diagonal 
elements  are  all  equal  to  unity,  enables  us  to  prove 
that  this  is  equivalent  to  the  property  (called  the 
consistency  property)  a^^a^j^  = a^j^  satisfied  by  all 

the  elements  of  A.  Now  we  turn  to  the  solvability  of 
the  eigenvalue  problem  (A-nl)  w=o.  This  homogeneous 
system  has  a nontrivial  solution  if  and  only  if  the 
determinant  of  the  matrix  (A-nl)  is  zero  from  which  it 
follows  that  n must  be  an  eigenvalue  of  A.  Now  it  is 

known  that  the  sum  of  the  eigenvalues  of  a matrix  is 
n 

equal  to  its  trace  J a. . . The  trace  of  A in  the 
i=l  “ 

paradigm  case  is  n.  Since  the  rank  of  A is  unity  all 
but  one  of  its  eigenvalues  is  zero.  Thus  the  maximum 
eigenvalue  of  A is  n. 

It  would  be  unrealistic  to  require  the  rela- 
tions (3.2)  to  hold  in  the  general  c se.  Imposing 
these  stringent  relations  would,  in  most  practical 
cases,  make  the  problem  of  finding  the  w^  (when  a^^ 
are  given)  unsolvable.  Firstly,  even  physical  measure- 
ments are  never  exact  in  a mathematical  sense,  and 
hence,  allowance  must  be  made  for  deviations;  and 
secondly,  because  of  error  in  humjn  judgments,  these 
deviations  are  considerably  larger.  Thus,  it  is  not 
reasonable  to  expect  the  consistency  condition  to 
always  hold. 


67 


A 


In  order  to  see  how  to  make  allowance  for 
deviations,  consider  the  i*"^  row  in  the  matrix  A.  The 
entries  in  that  row  are: 


il'  “i2' 


» f Si  . . f •••/ 

13  in 


In  the  paradigm  case  these  values  were  the 


same  as  the  ratios 


w . w . 

”1  "2 


Hence,  in  that  case,  if  we  multiply  the  first  entry  in 
that  row  by  w^^,  the  second  entry  by  and  so  on,  we 


would  obtain 


w . w . 

— w.  = w. , — w-  = w. , 
Wj^  1 1 W2  2 1 


w . 

^ w. 

Wj  1 

w . 

— w 
w n 
n 


The  result  is  a row  of  identical  entries 


”i'  ''i' 


''i- 


whereas,  in  the  general  case,  we  would  obtain  a row  of 
entries  that  represent  a statistical  scattering  of 
values  around  w^  which  amounts  to  a perturbation  of 
the  entries  a. . in  row  i. 

We  should  note  of  course,  that  large  changes 
in  the  values  of  a^^  could  mean  a drastic  departure 
from  consistency  and  more  importantly  from  the  exact 
values  of  the  ratios  w^/w^ . We  are  interested  in 
deriving  the  scale  of  w's  under  the  assumption  that 
the  judges  have  adequate  information  to  assist  in  the 
process.  Thus,  the  question  before  us  now  is  what 
happens  with  moderate  perturbations  of  the  coeffi- 
cients a . . . 


A useful  theorem  from  matrix  theory  says  that 
the  eigenvalues  X^  of  a matrix  B = 

depend  continuously  on  the  coefficients  ^12'  *'■' 

b . 

nn 

It  follows  that  a perturbation  of  the  entries 
a^j  in  the  paradigm  case  would  keep  the  largest  eigen- 
value in  the  neighborhood  of  n and  the  remaining  ones 
close  to  zero.  The  problem  becomes:  find  w which 
satisfies 


Aw  = X w 


max 

of  which  (3.3)  is  a special  case  when  A is  consistent. 

This  is  also  the  expression  we  would  obtain  from  the 

expression  in  (3.2)  involving  the  weighted  mean.  We 

note  that  to  each  X_  corresponds  a large  number  of 
max 

matrices.  Some  of  these  matrices  may  be  far  from  con- 
sistent. Thus,  the  same  eigenvector  can  arise  from 
many  matrices.  Among  all  such  matrices  we  shall  be 

interested  in  those  whose  largest  eigenvalue  is  n or 
X -n 

those  for  which  ; — is  small. 

n-1 

If  we  assume  that  the  values  are  estimated 
precisely,  i.e.,  a^^  = w^/w^ , it  is  then  sufficient 

to  require  consistency  of  the  judgment  matrix  to  obtain 
such  equality.  From  the  consistency  condition 
^ij^jk  ~ ^ik  have  for  the  main  diagonal  entries 

a.  . =1  and  the  reciprocal  relations  a. . = 1/a.  ..  In 

general,  we  do  not  expect  'cardinal'  consistency  to 
hold  everywhere  in  the  matrix  because  people's  feelings 
do  not  conform  to  an  exact  formula  such  as  the  one 
just  given.  Nor  do  we  expect  'ordinal'  consistency  as 
people  may  not  want  to  behave  that  way  (see  below) . 
However,  to  improve  consistency  in  the  numerical 


jucaqments,  whatever  value  a^^  is  assigned  in  comparing 
the  ith  activity  with  the  jth  one,  the  reciprocal  value 
is  assigned  to  a^j/  thus  putting  a^^  = . Roughly 

speaking,  if  one  activity  is  judged  to  be  a times 

stronger  than  another,  then  the  latter  is  only  1/a 

times  as  strong  as  the  former.  It  can  be  easily  seen 

that  when  we  have  consistency,  the  matrix  has  unit  rank 

and  it  is  sufficient  to  know  one  row  of  the  matrix  to 

construct  the  remaining  entries.  For  example,  if  we 

know  the  first  row  then  a. . = a, ./a, ■ (a  rational 

13  I3'  li 


assuming,  of  course,  that  a^^^  / 0 for  all  i)  . We  have 
found  the  interesting  theorem  that  a matrix  of  judg- 
ments which  uses  reciprocals  is  consistent  if  and  only 


if  = a. 


We  also  have  X > n always.  Thus 
max  — 


^max”^  provides  a measure  of  departure  from  consistency 

and  indicates  when  judgments  should  be  revised.  By 

comparing  X -n  with  dX_  for  extremely  bad  results, 
max  max  ■' 

one  can  tell  how  serious  the  inconsistency  is. 

We  do  not  insist  that  judgments  be  consistent 
and,  hence,  they  need  not  be  transitive;  i.e.,  if  the 
relative  importance  of  is  greater  than  that  of 
and  the  relative  importance  of  is  greater  than  that 
of  Cj,  then  the  relation  of  importance  of  need  not 
be  greater  than  that  of  C^,  a common  occurrence  in 
human  judgments.  An  interesting  illustration  is 
afforded  by  tournaments  regarding  inconsistency  or 
lack  of  transitivity  of  preferences.  A team  may 
lose  against  another  team  which  has  lost  to  a third 
team  C^;  yet  may  have  won  'against  C^.  Thus,  team 
behavior  is  inconsistent — a fact  which  has  to  be 
accepted  in  the  formulation,  and  nothing  can  be  done 
about  it. 


We  now  turn  to  a question  of  what  numerical 
scale  to  use  in  the  pairwise  comparison  matrices. 
Whatever  problem  we  deal  with  we  must  use  numbers  that 
are  sensible.  From  these  the  eigenvalue  process  would 
provide  a scale.  As  we  said  earlier,  the  best  argument 
in  favor  of  a scale  is  if  it  can  be  used  to  reproduce 
results  already  known  in  physics,  economics  or  what- 
ever area  that  there  is  a scale.  Enough  has  been  writ- 
ten in  this  field  to  fill  many  large  volumes.  However, 
one  of  the  most  appealing  works  in  the  area  of  the 
existence  of  ratio  scales  based  on  an  axiomatic  approach 
to  psychophysical  measurement  is  due  to  David  Krantz 
[4].  We  refer  the  reader  to  his  work.  Briefly,  com- 
paring our  theory  with  Krantz 's  work  suggests  that  this 
approach  is  on  the  right  track  in  producing  realistic 
answers . 

Our  choice  of  scale  hinges  on  the  following 
observation.  Roughly,  the  scale  should  satisfy  the 
requirements : 

1.  It  should  be  possible  to  represent  people’s 
differences  in  feelings  when  they  make  comparisons.  It 
should  also  represent  all  distinct  shades  of  feeling 
that  people  have. 

2.  It  must  satisfy  the  functional  equation 
f(x)f(i)  = 1 with  f(l)  =1 

The  simplest  nonconstant  function  which  satisfies  this 
equation  is  f (x)  = x. 

3.  If  we  denote  the  scale  values  by 

X,  , X.,,  ....  X , then  it  would  be  desirable  that 
12  n 

x^^j^  - x^  = 1 i = l,  ...,  n-1.  The  reasons  for  this 

are 

a)  we  need  uniformity  between  differences  to  make  sure 
that  the  scale  covers  all  judgments.  We  require  that 
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subject  must  be  aware  of  all  objects  at  the  same  time. 

b)  We  agree  with  the  psychological  experiments  which 
show  that  an  individual  cannot  simultaneously  compare 
more  than  seven  objects  (plus  or  minus  two)  without 
being  confused. 

c)  If  a unit  difference  between  successive  scale 
values  is  all  that  we  allow,  then  by  requiring  uniform- 
ity and  using  the  fact  that  Xj^  = l for  the  identity  com- 
parison, it  follows  that  the  scale  values  will  range 
from  one  to  nine. 

As  a preliminary  step  towards  the  construction 
of  an  intensity  scale  of  importance  for  activities,  we 
i have  broken  down  the  importance  ranks  as  follows: 

I 

I Intensity 

! of 


Importance 

Definition 

Explanation 

1* 

Equal  Importance 

Two  activities  contribute 
equally  to  the  objective. 

3 

Weak  importance 
of  one  over 
another. 

The  judgment  favors  one 
activity  over  another, 
but  it  is  not  conclusive. 

5 

Essential  or 
strong  importance. 

The  judgment  and  logical 
criteria  show  that  one  is 
more  important. 

7 

Demonstrated 
importance . 

Conclusive  judgment  as  to 
the  importance  of  one 
activity  over  another. 

9 

Absolute 
importance . 

The  judgment  in  favor  of 
one  activity  over  another 
is  of  the  highest  possible 
order  of  affirmation 

2, 4, 6, 8 

Intermediate 
values  between 
the  two  adjacent 
judgments . 

When  compromise  is  needed. 

*0n  occasion  in  2 by  2 problems,  we  have  used  1 + e, 

0 < e < i to  indicate  very  slight  dominance  between  two 
nearly  2 equal  activities. 
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Definition 


Explanation 


Intensity 

of 

Importance 


Reciprocals  If  activity  i has  See  below, 
of  above  non-  one  of  the  above 
zero  numbers  non-zero  numbers 
assigned  to  it 
when  compared  with 
activity  j,  then  j 
has  the  reciprocal 
value  when  compared 
with  i. 

Rationals  Ratios  arising  from  If  consistency  were 

the  scale.  to  be  forced  by 

obtaining  n numerical 
values  to  span  the 
matrix . 

In  using  this  scale  the  reader  should  recall 
that  we  assume  that  the  individual  providing  the  judg- 
ment has  knowledge  about  the  relative  values  of  the 
elements  being  compared  whose  ratio  is  ^ 1,  and  that 
the  numerical  ratios  he  forms  are  nearest  integer 
approximations  scaled  in  such  a way  that  the  highest 
ratio  corresponds  to  9.  We  have  assumed  that  an  element 
with  weight  zero  is  eliminated  from  comparison.  This, 
of  course,  need  not  imply  that  zero  may  not  be  used  for 
pairwise  comparisons.  Reciprocals  of  all  scaled  ratios 
that  are  ^ 1 are  entered  in  the  transpose  positions 
(not  taken  as  judgments)  with  a zero  for  the  transpose 
of  a zero  entry.  Note  that  the  solution  of  the  prob- 
lem remains  the  same  if  we  multiply  the  unit  entries 
on  the  main  diagonal  by  a constant.  Thus,  despite 
scaling,  each  main  diagonal  element  may  continue  to 
equal  unity.  In  practice,  one  way  or  another,  the 
numerical  judgments  will  have  to  be  approximations, 
but  how  good  is  the  question  at  which  our  theory  is 
aimed. 
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I A typical  question  to  ask  in  order  to  fill  in  the 

entries  in  a matrix  of  comparisons  is:  Consider  two 
properties  i on  the  left  side  of  the  matrix  and  another 
j on  the  top;  which  of  the  two  has  the  property  under 
discussion  more,  and  how  strongly  more  (using  the  same 
values  1 to  9) . This  gives  us  a^j*  The  reciprocal 
value  is  then  automatically  entered  for  a... 

Example  1.  The  rate  at  which  a source  emits 
light  energy  evaluated  in  terms  of  its  visual  effects 
is  spoken  of  as  a light  flux.  The  illumination  of  a 
surface  is  defined  as  the  amount  of  light  flux  it 
receives  per  unit  area. 

The  following  experiment  was  conducted  in 
search  of  a relationship  between  the  illumination 
received  by  four  identical  objects  (placed  on  a line 
at  known  distances  from  a light  source)  and  of  the 
distance  from  the  source.  The  comparison  of  illumina- 
tion intensity  was  performed  visually  and  independently 
by  two  sets  of  people.  The  objects  were  placed  at  the 
following  distances  measured  in  yards  from  the  light 
source:  9,  13,  21,  and  28.  In  normalized  form,  these 

distances  are:  .123,  .205,  .288,  .384. 

The  two  matrices  of  pairwise  comparisons  of  the 
brightness  of  the  objects  labelled  in  increasing  order 


Relative  Brightness 
Eigenvector 
(1st  Trial) 


Reciprocal  of  Corresponding 
Normalized  Distance  Square 


Normalized  Reciprocal 
Distance  Square 


Note  the  sensitivity  of  the  results  as  the 
object  is  very  close  to  the  source  for  then  it  absorbs 
most  of  the  value  of  the  relative  index  and  a small 
error  in  its  distance  from  the  source  yields  great 
error  in  the  values.  What  is  noteworthy  from  this 
sensory  experiment  is  the  observation  or  hypothesis 
that  the  observed  intensity  of  illumination  varies 
(approximately)  inversely  with  the  square  of  the 
distance.  The  more  carefully  designed  the  experiment 
the  better  results  obtained  from  the  visual  observation 
Statistical  measures  may  be  used  to  confirm  the  close- 
ness of  the  observed  results  with  the  actual. 


Example  2:  V-i6tancz  Eitimation  ThAoucjh  KUi  Tnauel  ExpeAcewce 


The  Eigenvalue  Method  was  used  to  estimate  the 
relative  distance  of  six  cities  from  Philadelphia  by 
ma)cing  pairwise  comparisons  between  them  as  to  which 
was  strongly  farther  from  Philadelphia. 


It  is  interesting  to  note  that  the  cities 
cluster  into  three  classes — the  near  ones  to  Philadel- 
phia, Montreal,  and  Chicago;  the  intermediate  ones: 

San  Francisco  and  London;  and  the  far  ones  cause  a 
great  perturbation  in  the  entire  system  because  their 
eigenvector  components  change  comparatively  slightly 
but  as  the  increment  is  distributed  among  the  others, 
their  relative  values  can  be  altered  considerably. 

Probably  the  problem  should  be  reformulated 
with  clustering  taken  into  account.  It  leads  to  a 
consideration  of  clusters  on  the  same  level.  The 
elements  in  each  cluster  are  first  compared  and  then 
the  clusters  would  be  themselves  compared  to  obtain 
the  appropriate  weights. 

Now  for  the  example.  The  first  three  tables 
give  the  original  judgments  matrix  with  charges  made 
in  it  in  the  other  two;  and  the  fourth  table  gives  the 
results . 
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4.0  H-ie/iaAclUeA  and  TheJji  PfiopcAZiu.  Although  the  notion 
of  a hierarchy  is  old,  our  method  of  measurement  in 
hierarchical  structures  is  new.  It  cannot  be  compared 
with  any  analytical  macro  models  because  so  far  all 
such  modelling  manages  to  pull  all  its  variables  into 
a single  level.  What  we  need  to  do  is  apply  our 
analysis  to  problems  whose  hierarchical  structure  is 
carefully  defined  and  note  the  results  for  their  rele- 
vance and  validity.  Methods  involving  optimization 
with  multiple  objectives  do  not  offer  justification 
for  the  use  of  ratio  scaling.  Careful  examination  of 
that  literature  has  not  benefited  our  approach  to 
hierarchies.  Perhaps  one  of  the  most  interesting 
analytical  works  which  have  enriched  the  concept  of  a 
hierarchy  is  the  paper  by  H.  Simon  and  A.  Ando  [15] 
from  which  the  first  author  derived  many  insights  into 
hierarchies  for  his  subsequent  works  on  the  subject. 

Any  system  is  a large  matrix  of  interactions 
between  its  components  in  which  most  of  the  entries 
are  (close  to)  zero.  Ordering  those  entries  according 
to  their  orders  of  magnitude,  a distinct  hierarchic 
structure,  is  discerned.  In  fact,  this  arrangement  of 
the  elements  of  a system  in  an  incidence  type  matrix 
can  be  used  to  identify  the  levels  of  a hierarchy. 

The  stability,  or  functional  efficacy  of  the  higher 
level  structures,  can  be  made  relatively  independent 
of  the  detail  of  their  microscopic  components  by  virtue 
of  hierarchic  structure.  Such  a structure  also  pro- 
vides explanation  as  to  why  elements  in  any  given  level 
can  preserve  a measure  of  independence  to  adapt  their 
structure  and  function  to  the  environment  without 
destroying  their  usefulness  to  the  system. 

The  laws  characterizing  different  levels  of  a 
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hierarchy  are  generally  different.  The  levels  differ 
both  in  structure  and  function.  The  proper  functioning 
of  a higher  level  depends  on  the  proper  functioning  of 
the  lower  levels.  The  basic  problem  with  a hierarchy 
is  to  seek  understanding  at  the  highest  levels  from 
interactions  of  the  various  levels  of  the  hierarchy 
rather  than  directly  from  the  elements  of  the  levels. 

At  this  stage  of  development  of  the  theory  the  choice 
of  levels  in  a hierarchy  generally  depends  on  the  knowl- 
edge and  interpretation  of  the  observer.  Rigorous 
methods  for  structuring  systems  into  hierarchies  are 
gradually  emerging  in  the  many  areas  of  the  natural 
and  social  sciences  and,  in  particular,  in  general 
systems  theory  as  it  relates  to  the  planning  and  design 
of  social  systems. 

What  -ii  a HieMiAchij? 

VzftinLtLon  1.  An  ordered  set  is  any  set  S with  a binary 
relation  < which  satisfies  the  reflexive,  anti- 
symmetric, and  transitive  laws: 

Reflexive:  For  all  x,  x < x; 

Anti-symmetric:  If  x ^ y and  y £ x,  then  x = y; 

Transitive:  If  x £ y and  y £ z,  then  x ^ z. 

For  any  relation  x ^ y (read,  y includes  x)  of 
this  type,  we  may  define  x < y to  mean  that  x £ y and 
X y.  y is  said  to  cover  (dominate)  x if  x < y and 
if  X < t < y is  possible  for  no  t. 

Ordered  sets  with  a finite  number  of  elements 
can  be  conveniently  represented  by  a directed  graph. 

Each  element  of  the  system  is  represented  by  a vertex 
so  that  an  arc  is  directed  from  a to  b if  b < a. 
Vc^tnition  2.  A simply  or  totally  ordered  set  (also 
called  a chain)  is  an  ordered  set  with  the  additional 
property  that  if  x,  y e S then  either  x £ y or  y £ x. 
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De.(tiru-t^on  3.  A subset  E of  an  ordered  set  S is  said  to 
be  bounded  from  above  if  there  is  an  element  s e S such 
that  X £ s for  every  x c E.  The  element  s is  called 
an  upper  bound  of  E.  We  say  E has  a supremum  or  least 
upper  bound  in  S if  E has  upper  bounds  and  if  the  set 
of  upper  bounds  U has  an  element  u^^  such  that  Uj^  £ u 
for  all  u c U.  The  element  u is  unique  and  is  called 
the  supremum  of  E in  S.  The  symbol  sup  is  used  to 
represent  a supremum. 

Similar  definitions  may  be  given  for  sets 
bounded  from  below,  a lower  bound  and  inf imum.  The 
symbol  inf  is  used. 

Vei-in-Ctcon  4.  A sup-lattice  is  an  ordered  set  in  which 
any  two  elements  x and  y have  a supremum.  An  inf- 
lattice  in  an  ordered  set  in  which  any  two  elements  x 
and  y have  an  infimum.  A lattice  is  an  ordered  set 
that  is  both  a sup-lattice  and  an  inf-lattice. 

There  are  many  ways  of  defining  a hierarchy. 

The  one  which  suits  our  needs  best  here  is  the  follow- 
ing: 

We  use  the  notation  x = {y|x  covers  y}  and 
x^  = {y|y  covers  x},  for  any  element  x in  an  ordered 
set. 

Ve^'irU-tion  5.  Let  H be  a finite  sup-lattice  with  largest 
element  b. 

H is  a hierarchy  if  it  satisfies  the  conditions 


a) 

There  is  a partition  of 
Lj^,  k = 1,  ...,  h where 

H into  sets 

= {b}. 

b) 

xeLj^  implies  x~C 

k = 1, 

• mm/ 

h-1 

c) 

xeLj,  implies  x^C 

k = 2, 

• • • f 

h. 

For 

each  xeH,  there  is  a weighting 

w : X -►  [0,1]  such  that  w 

function 

(y)  = 1. 
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The  sets  are  the  levels  of  the  hierarchy, 

and  the  function  is  the  priority  function  of  the 

elements  in  one  level  with  respect  to  the  objective  x. 

We  observe,  that  even  if  x”  ^ (for  some  level 

may  be  defined  for  all  of  Lj^,  by  setting  it  equal 

to  zero  for  all  elements  in  L,  not  in  x . 

k 

Oe.(iifiction  6.  A hierarchy  is  complete  if,  for  all 
xeLj^,  x^  = for  k = 2,  ...,  h. 

We  can  now  state  the  central  question; 

Baj-i-C  P>wbiejn:  Given  any  element  xeL  , and  subset  S C Lq, 

a p 

(a<B)  , how  do  we  define  a function  w S-*-(0,lI, 

X f o 

which  reflects  the  properties  of  the  priority  func- 
tions Wy  on  the  levels  Lj^,  k = a+1,  ...,  0?  Specifi'- 
cally,  what  is  the  function  w:  [0,1]? 

In  less  technical  terms,  this  can  be  para- 
phrased thus: 

Given  a social  (or  economic)  system  with  a 
major  objective  b,  and  the  set  of  basic  activities, 
such  that  the  system  can  be  modelled  as  a hierarchy 
with  largest  element  b and  lowest  level  What  are 

the  priorities  of  the  elements  of  with  respect  to 
b? 

Remark  H:  We  assume  that  the  elements  in  each 
level  may  belong  to  more  than  a single  hierarchy.  To 
measure  their  priority  they  must  be  regarded  as 
independent  within  a given  hierarchy. 

From  the  standpoint  of  optimization,  to  allo- 
cate a resource  among  the  elements  any  interdependence 
must  also  be  considered.  Analytically,  interdependence 
may  take  the  form  of  input-output  relations  such  as , 
for  example,  the  interflow  of  products  between  indus- 
tries. A high  priority  industry  may  depend  on  flow 
of  material  from  a low  priority  industry.  In  an 
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optimization  framework,  the  priority  of  the  elements 
enables  one  to  define  the  objective  function  to  be 
maximized,  and  other  hierarchies  supply  information 
regarding  constraints,  e.g.,  input-output  relations. 

We  shall  now  present  our  method  to  solve  the 

Basic  Problem.  Assume  that  Y = {y^^,...,  ^ ^ 

"’k 

that  X = {x. , . . . , X } e ^k+1  (observe,  that  accord- 
^ "'k+1 

ing  to  the  remark  following  definition  5,  we  may  assume 
that  Y = Lj^  ) . Also  assume  that  there  is  an  element 
zeLk_i,  such  that  Y C z . Then  we  consider  the  priority 

functions 


w^:  Y->-[0,l]  and  w^:  X->-[0,l]  j = 1,  ..., 

We  construct  the  "priority  function  of  the  elements  in 
Y with  respect  to  z,"  denoted  w , w:  Y->-[0,l),  by 

""k 

w(Xi)  = Wy^(x.)w^(y.)  , i = 1 m^^^ 

It  is  obvious  that  this  is  no  more  than  the  process  of 
weighting  the  influence  of  the  element  y^  on  the 
priority  of  x^  by  multiplying  it  with  the  importance  of 
y^  with  respect  to  z. 

As  we  saw  in  example  1,  the  algorithms  involved 

will  be  simplified  if  one  combines  the  w (x.)  into  a 

Yj  1 

matrix  B by  setting  b^ . = w (x. ) . If  we  further  set 

J y -i  ^ 


w.  = w(x.)  and  w'.  = w (y.),  then  the  above  formula 

1 1 3 ^ J 

becomes  _ 


Thus  we  may  speak  of  the  priority  vector  w and,  indeed, 
of  the  priority  matrix  B;  this  gives  the  final  formulation 
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The  following  is  easy  to  prove: 

Theoiem  1:  Let  H be  a complete  hierarchy  with  largest 
element  b and  h levels.  Let  be  the  priority  matrix 
of  the  k-th  level,  k = 1,  h.  If  w'  is  the 

priority  vector  of  the  p-th  level  with  respect  to  some 
element  z in  the  (p-l)st  level,  then  the  priority  vec- 
tor w of  the  q-th  level  (p<q)  with  respect  to  z is 
given  by 


w = B B . 
q q-1 


B ^.w' 
P+1 


Thus  the  priority  vector  of  the  lowest  level  with 
respect  to  the  element  b is  given  by: 


w = B,  B 
h 


h-1 


B2w' 


The  following  observation  holds  for  a complete 
hierarchy — but  it  is  also  useful  in  general.  The 
priority  of  an  element  in  a level  is  the  sum  of  its 
priorities  in  each  of  the  subsets  to  which  it  belongs, 
each  weighted  by  the  fraction  of  elements  of  the  level 
which  belong  to  that  subset  and  by  the  priority  of  that 
subset.  The  resulting  set  of  priorities  of  the  ele- 
ments in  the  level  is  then  normalized  by  dividing  by 
its  sum.  The  priority  of  a subset  in  a level  is 
equal  to  the  priority  of  the  dominating  element  in  the 
next  level. 

The  following  two  figures  are  illustrations  of 
hierarchies  used  in  applications. 
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Figure  2 (continued) 


First  hierarchy  level  has  a single  objective 
as  a criterion  below.  Its  priority  value  is 
assumed  to  equal  unity. 

Second  hierarchy  level  objectives  have  priority 
derived  from  their  matrix  of  comparison  of 
their  impact  on  the  objective  given  in  the 
first  level. 

Third  hierarchy  level  objectives  fall  in 
group  according  to  which  element  of  the 
second  hierarchy  they  contribute.  Their 
overall  priority  is  obtained  from  the  matrix 
of  comparison  of  their  impact  on  the  relevant 
objective  of  the  second  level  multiplied  by 
n^/m  (the  fraction  of  elements  in  their  group 

indicated  by  dotted  lines  with  ^n^=m  where  i 
is  the  index  of  groupings)  and  by  the 
priority  of  the  element  from  the  second  level 
class  they  fall  under.  Sum  of  the  priorities 
in  each  level  must  add  up  to  unity.  This  is 
done  by  a normalization  process  of  dividing 
the  priority  of  each  objective  by  the  sum  of 
all  priorities  in  the  level. 

Lower  hierarchy  level  priorities  are  similar 
derived  based  on  the  immediately  preceding 
level. 
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Ex.amptzi . We  shall  be  satisfied  here  with  elementary 
examples  to  illustrate  the  main  ideas  and  perhaps  also 
heighten  the  interest  of  the  reader  in  some  potential 
areas  to  which  they  can  be  applied.  These  examples 
can  be  subjected  to  variations  in  the  structure  to 
test  for  sensitivity.  It  turns  out  that  the  results 
are  not  sensitive  to  changing  the  number  of  elements 
by  a few  and  even  to  perturbations  in  the  number  of 
levels.  The  reader  will  undoubtedly  discern  the  gener- 
ality of  the  method.  By  applying  it  he  will  experience 
its  power  to  produce  answers  which  can  be  validated  on 
the  basis  of  the  information  available. 

Perhaps  the  most  important  point  to  make  here, 
is  that  this  type  of  ratio  scale  estimate  having  been 
found  successful  in  the  physical  sciences  can  be  used 
to  evaluate  social  progress  where  money  or  other 
economic  measures  are  not  the  only  significant  indices. 
We  can  estimate  environmental  impacts  in  terms  of  the 
various  effects  pollutants  have  including  those  on 
health  or  even  happiness,  however  we  may  wish  to  define 
it.  Multi-objective  criteria  weighting  receives  an 
integrated  treatment  within  such  a hierarchical  frame- 
work. 

Example  3.  Three  highschools  were  analyzed  from  the 
standpoint  of  a candidate  according  to  their  desir- 
ability. Six  characteristics  were  selected  for  the 
comparison.  They  are:  learning,  friends,  school  life, 
vocational  training,  college  preparation  and  music 
classes.  The  pairwise  judgment  matrices  were  as 
follows : 


] 


1 

i' 

'{ 

) 

r 

r 

f 

il 


Vocational  Trainin* 


College  Preparation 


Music  Classes 


f I 
[! 

f; 

I 

I 

'I 


V B C 


A 1 
B 1/9 
C 1/7 


9 7 

1 1/5 

5 1 


A 

B 

c 

A 

1 

1/2 

1 

B 

2 

1 

2 

C 

1 

1/2 

1 

A 


A 1 
B 1/6 
C 1/4 


B 

6 

1 

3 


( 

4 

1/3 

1 


The  eigenvector  of  the  first  matrix  is  given  by: 
(.32,  .14,  .04,  .13,  .24,  .14) 

and  its  corresponding  eigenvalue  is  X = 7.49  which  is 
slightly  far  from  the  consistent  value  6. 

The  eigenvalues  and  eigenvectors  of  the  other 
six  matrices  are: 


X = 3.05 

Learning 

X=3  X=3  X=  3.21  X = 3.00  X = 3.05 

Choosing  School  Problem 

Friends  School  Life  Vocational  Training 

. 16 

. 33 

.45 

.77 

. 59 

. 33 

. 09 

.05 

.25 

. 33 

.46 

. 17 

College 

Preparation 

Music 

.25 

.69 

. 50 

.09 

.25 

.22 

To  obtain  the  overall  ranking  of  the  schools, 
we  multiply  the  matrix  whose  columns  are  these  vectors 
on  the  right  by  the  transpose  of  the  vector  of  weights 
of  the  characteristics.  This  yields: 

A = . 37;  B = . 38;  C = . 25 

The  individual  went  to  school  A because  it  had  almost 
the  same  rank  as  school  B,  and  he  wanted  to  go  there. 
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He  a been  going  to  school  B before  the  analysis  was 
made . 

Example  4.  The  hierarchical  method  of  prioritization  may 
be  used  to  provide  insight  into  psychological  problem 
areas  in  the  following  manner: 

Consider  an  individual's  overall  wellbeing  as  the  single 
top  level  entry  in  a hierarchy.  Conceivably  this  level 
is  primarily  affected  by  childhood,  adolescent  and  adult 
experiences.  Factors  in  growth  and  maturity  which 
impinge  upon  wellbeing  may  be  the  influences  of  the 
father  and  the  mother  separately  as  well  as  their  in- 
fluences together  as  parents;  the  socio-economic  back- 
ground; sibling  relationships;  one  peer  group;  schooling; 
religious  status  and  so  on. 

The  factors  above,  which  comprise  the  second 
level  in  our  hierarchy,  are  further  affected  by  criteria 
pertinent  to  each.  For  example,  the  influence  of  the 
father  may  be  broken  down  to  include  his  temperament, 
strictness,  care  and  affection.  Sibling  relationships 
can  be  further  characterized  by  the  number,  age  dif- 
ferential and  sexes  of  siblings;  peer  pressure  and  role 
modeling  provide  a still  clearer  picture  of  the  effects 
of  friends,  schooling,  teachers. 

As  an  alternative  framework  of  description  for 
the  second  level,  we  might  include  self-respect, 
security,  adaptability  to  new  people  and  new  circum- 
stances and  so  on  influencing  or  as  influenced  by  the 
elements  above. 

A more  complete  setting  for  a psychological 
history  might  include  several  hundreds  of  elements  at 
each  level,  chosen  by  trained  individuals,  and  placed 
in  such  a way  as  to  derive  the  maximum  understanding  of 
the  subject  in  question. 
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Here  we  will  consider  a highly  restricted  form 
of  the  above,  where  the  individual  in  question  feels 
his  self  confidence  has  been  severely  undermined  and 
his  social  adjustments  impaired  by  a restrictive  situ- 
ation during  childhood.  He  is  questioned  about  his 
childhood  experiences  only,  and  asked  to  relate  the 
following  elements  pairwise,  on  each  level: 

Level  I Overall  Wellbeing  (O.W. ) 

Level  TI  Self-respect,  Sense  of  Security, 

Ability  to  adapt  to  others  (R,S,A) 

Level  III  Visible  affection  shown  for 
subject,  (V) 

Ideas  of  Strictness,  Ethics,  (E) 
Actual  disciplining  of  child, (D) 
Emphasis  on  personal  adjustment 
with  others  (0) 

Level  IV  Influence  of  the  Mother, 

Father,  Both  (M,F,B) 

The  replies  in  matrix  form  were  as  follows: 

O.W. 

R S A 


1 6 

1/6  1 

1/4  1/3 


V 

E 

D 

0 

V 

E 

D 

0 

V 

E 

D 

0 

V 

1 

6 

6 

3 

V 

1 

6 

6 

3 

V 

1 

5 

3 

1 

E 

6 

1 

4 

3 

E 

_1_ 

6 

1 

4 

3 

5 

1 

4 

s 

D 

6 

h 

1 

h 

D 

J_ 

6 

h 

1 

>3 

D 

3 

*« 

1 

>5 

± 

3 

j. 

3 

2 

1 

0 

X 

3 

3 

2 

1 

0 

1 

5 

4 

1 
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The  eigenvector  of  the  first  matrix,  a,  is 


given  by 


R 

.701 

S 

.193 

A 

.106 

The 

matrix 

, b,  of 

eigenvectors  of 

the  second 

row  of  matrices  is 

given 

by 

R 

S 

A 

V 

.604 

.604 

. 127 

E 

.213 

.213 

.281 

D 

. 064 

. 064 

. 120 

0 

.119 

.119 

.463 

The 

matrix 

/ c,  of 

eigenvectors  of 

the  third  row 

of  matrices 

is  given  by 

V 

E 

D 

0 

M 

.721 

.333 

.713 

.701 

F 

.210 

. 333 

.061 

.097 

B 

. 069 

. 333 

.176 

. 202 

The 

final 

composite  vector 

of  influence  on 

well-being  obtained  from  the  product  cba  is  given  by 

Mother  .635 
Father  .209 
Both  .156 


The  subject  demonstrates  that  the  input  of  the 
mother  in  terms  of  the  elements  considered  here  far 
outweighs  the  father's  effect  in  childhood.  Interpre- 
tations obviously  vary.  An  improper  parental  balance 
rather  than  a restrictive  situation  is  indicated.  In 
any  case  the  method  is  extremely  versatile  for  inter- 
preting situations  and  locating  problem  sources  such  as 
determining  the  relative  strengths  of  the  parents. 

5.0  ConctudLnq  Remafiki.  We  have  undertaken  comparisons 
of  the  eigenvalue  approach  to  measurement  with  the 
) methods  of  S.S.  Stevens  and  with  the  method  of  least 

j squares  as  two  of  the  most  important  methods  one  may  be 

^ inclined  to  use  in  deriving  a ratio  scale.  First, 

i neither  of  these  methods  is  implicitly  concerned  in  its 

derivation  with  the  important  measure  of  consistency 
as  does  the  eigenvalue  approach.  The  eigenvalue 
approach,  as  the  least  square  method,  relies  on  the  use 
of  redundant  information  to  improve  precision.  Both 
latter  methods  are  based  on  perturbation  equations 
which  arise  in  estimating  ratios  in  pairwise  compari- 
sons. Unlike  the  more  general  parameterization  in  the 
eigenvalue  approach,  least  square  approximation 
degenerates  to  the  same  set  of  assumptions  with  or 
without  consistency.  Minimizing  squares  is  convenient 
but  is  not  a process  intrinsic  to  scale  derivation  any 
more  than  minimizing  the  fourth  power  would  be.  How- 
ever, when  it  is  known  that  we  have  near  consistency, 
a least  squares  solution  is  a good  approximation  to 
the  eigenvalue  problem.  Comparison  with  the  method  of 
S.S.  Stevens  by  having  judges  locate  their  relative 
preferences  of  the  items  being  compared  on  a line  seg- 
ment of  prescribed  length  produced  less  precision  for 
the  latter  method  as  the  method  does  not  provide  a 


systematic  way  of  improving  overall  consistency  by 
using  redundant  information.  Stevens'  power  law  does 
not  seem  to  be  an  essential  part  of  the  eigenvalue 
solution . 

Hierarchic  use  of  the  eigenvalue  method  yields 
results  on  a unidimensional  scale.  The  practical  use- 
fulness o&  such  a scale  is  considerable.  For  it  to  be 
useful,  it  must  yield  answers  in  conformity  with  logic. 
But  this  can  be  expected  from  the  method  of  weighting 
used  to  derive  the  scale. 

The  power  relation  itself  may  be  reflected  in 
I the  scale  used  for  making  the  pairwise  comparisons. 

But  in  all  the  examples  considered  there  does  not  seem 
to  be  any  reason  to  conclude,  by  comparing  the  matrix 
of  estimated  values  (a. .)  with  the  matrix  of  ratios 

I 

(w^/w j ) that  a^j  = (w^/Wj)“.  This  observation  applies 

both  to  prothetic  (quantitative  in  nature)  and 
metathetic  (qualitative  in  nature)  data  discussed  by 
S.S.  Stevens.  Experiments  are  under  way  by  a psycholo- 
gist to  compare  the  two  methods  using  heat  lamps  to 
|1  shine  light  on  subjects'  upper  back  part. 
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Solve  optimization  problem  as  in  c)  subject  to  these  constraints. 


Thus,  after  systematically  structuring  a 
system  into  a hierarchy,  the  eigenvalue  method  is  used 
to  study  the  laws  of  interaction  between  its  levels  and 
by  superposition,  the  impact  of  any  level  on  the  over- 
all hierarchy  may  be  obtained  through  the  composite 
vector  for  that  level.  This  provides  a method  for 
studying  a fundamental  problem  in  systems  theory--the 
effect  of  the  parts  of  a system  on  the  whole. 

The  research  is  being  extended  to  another  type 
of  hierarchy  with  feedback  called  a holarchy  and  to  a 
system  that  is  represented  as  a network.  The  question 
of  the  stability  of  a hierarchy  to  perturbations  in 
its  elements  and  levels  is  also  being  researched.  A , 
detailed  paper  with  theorems  justifying  the  approach 
exists . 
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REMARKS  ON  THE  PRESENTATICN  GIVEN  BY  THOMAS 
L.  SAATY  ETOM  THE  UNIVERSITY  OF  MICHIGAN 


by  CLYDE  H.  COOMBS 
UiiiveA^ity  0|S  UiclUgan 


Dr.  Saaty's  approach  to  a coiplex  decision  prcfclan  is  an 
instance  of  a general  procedure  called  multiattribute  utility 
theory  viiich  is  the  most  widely  used  model  today  and,  indeed,  it 
quite  dcminates  the  field.  Dr.  Honan's  paper  yesterday  provided 
a good  exanple  of  this  model  used  to  aid  decisionmaking  for  a 
naval  force  ccmander.  The  popularity  of  the  model  is  such  that 
one  attacks  it  with  sene  trepidaticn  - except  that  setne  of  tie 
foremost  proponents  of  the  model  don't  believe  people  behave  that 
way  but  they  like  it  because  it  is  a good  prescriptive  model  and 
insines  seme  rationality. 

Criticians  and  questions  raised  about  vdiat  Dr.  Saaty  talked 
about  may  equally  well  be  raised  about  the  mulattribute  utility 
and  maximum  expected  utility. 

What  the  model  does  in  brief  is  to  cut  an  opticxi  up  into 
pieces,  its  facets  or  cerponents,  assign  utilities  or  values  to 
each  facet,  reflecting  their  desirability,  with  v^ights  or  prob- 
abilities reflecting  their  inportance  or  likelihood  of  occurrence, 
and  then  aggregates  than  into  a total  value,  the  expected  utility, 
for  each  option  as  a vbole,  and  then  choose  by  maximizing. 

What  Dr.  Saaty  has  contributed  is  a new  and  cleaver  way  of 
estimating  the  utilities  to  be  associated  with  the  various  com- 
ponents of  an  option. 

Tom's  talk  this  morning  was  very  interesting  and  the  results 
intuitively  caipelling.  Fran  the  point  of  view  of  nodelling  it 
is  nort  enough,  however,  to  do  a study  in  vdiich  the  model  fits 
significantly. 

One  vrants  to  know  if  one  can  do  an  experiment  in  which  the 
model  will  not  fit  and  then  vrfiat  are  the  characteristics  of  such 
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experiments. 

In  other  words  vAiat  are  the  conditions  that  characterize  the 
model,  that  control  its  degree  of  fit. 

This  model  makes  certain  assmptions  viAiich  must  be  satisfied 
for  accurate  results.  The  conponent  factors  must  be  a mutually 
independent  and  eshaustive  list  and  conbine  additively  without 
the  values  interacting  with  their  weights  or  probabilities. 

These  characteristics  of  the  method  are  well-known  but  are 
not  easy  to  satisfy.  Another  assutiption  of  the  model  reflects 
the  fact  that  the  deccrposition  of  an  option  into  all  its  dis- 
joint cotponents  may  not  be  unique-and  that  requireitient  is  that 
the  aggregate  value  of  an  option  must  be  invariant  over  all  pos- 
sible such  decoipositions . 

Tte  model  is  designed  to  play  the  role  of  the  decision 
maker,  the  comander.  I like  the  attitude  expressed  by  Dr. 
Wagner  that  a model  should  provide  insights,  of  a qualitative 
nature,  and  point  directions.  I presume  that  v*at  he  has  in 
mind  is  that  the  model  must  be  an  aid  to  the  ccrmander  but  leave 
the  ultimate  decision  up  to  him,  for  reasons  which  I will  try  to 
spell  out  shortly. 

Maximum  expected  utility  is  a model  in  which  the  camander 
would  only  be  used  to  assess  utilities  and  weights  or  probabil- 
ities and  then  it  will  put  than  all  together.  When  the  condi- 
tions for  the  model  are  not  satisfied  it  may  cctne  up  with  an 
answer  which  is  then  rejected.  I am  raninded  here  of  a study 
made  at  the  behest  of  the  Mexican  government  to  determine  the 
best  location  for  a new  International  airport  for  Mexico  City. 
Specialists  and  experts  in  Mexico  City  were  used  to  estimate 
values  and  costs  for  demographic  factors,  pollution  factors, 
economic,  social  and  physical  factors.  The  solution  the  model 
arrived  at  was  rejected  by  the  City  fathers  for  essentially 
political  reasons  which  were  not  adequately  represented  in  the 
deccmposition. 
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However,  one  of  the  great  values  of  this  model,  this 
approach  to  the  decision  problcan,  is  that  it  leads,  in  fact, 
forces,  the  decision  naker  to  examine  each  of  his  options  in 
terms  of  all  its  facets,  its  bits  and  pieces  in  detail,  to  pen- 
etrate the  problan  to  a greater  depth  than  he  is  likely  to  in 
the  absence  of  the  model. 

A major  reservation  I have  about  this  approach  is  that  the 
opticxis  are  invariably  risky  ones  and  it  has  surprised  me  that 
the  noticxi  of  risk  and  risk-taking  has  so  little  entered  into 
I the  discussion.  General  Welch  mentioned  it  in  his  talk  and  so 

j did  Dr.  Hcman  yesterday  morning  and  Mr.  Robinson  in  the  afternoon 

; vhen  he  referred  to  rash  and  cautious  canranders.  These  refer- 

ences, however,  were  casual  and  passing,  and  I think  that  the 
j,  reason  for  this  is  that  utility  theory  preenpts  the  concept  of 

f 

, risk,  it  is  redundant. 

I 

In  the  von  Neuman  axioms  for  measure  utility,  for  exanple, a 

, I 

risky  proposition  is  put  up  versus  a sure  thing  and  if  the  indi- 
I i vidual  does  not  maximize  expectexl  value  when  he  indicates  his 

I choice,  then  the  utility  function  is  shaped  to  explain  his  beha- 

t I vior  as  maximizing  expected  utility  - there  is  nothing  left  over 

I for  a notion  of  risk.  Unfortunately  it  can  be  shown  without 

much  difficulty  that  maximum  expected  utility  is  incorrect  as  a 
descriptive  theory. 

It  seems  to  me  that  the  notion  of  risk  is  a significant 
j psychological  variable  in  the  options  acomander  faces.  The 

! efficient  options  consist  of  options  in  which  the  risk  is  mini- 

mal for  the  gain  to  be  expected  and  the  gain  is  maximal  for  the 
j risk  undertaken.  So  the  choice  then  is  a matter  of  the  trade 

off  between  what  more  you  expect  to  gain  for  taking  an  option 
with  more  risk.  This  parallels  the  problem  of  portfolio  selec- 
tion in  eoDrcmic  theory.  In  Mackowitz's  theory  of  Portfolio 
selection  risk  is  defined  in  terms  of  variance  and  an  efficient 

tset  of  optiois  is  determined  on  the  basis  of  minimizing  risk 

holding  expected  value  constant  and  maximizing  expected  value 

I 

I 
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holding  the  variance  constant.  Tiie  set  of  options  arrived  at 
are  all  equivalent  by  definitirm.  They  are  not,  of  course, 
equivalent  fron  the  point  of  view  of  human  choice.  This  is  an 
individual  matter  of  trade  off  betveen  risk  and  expected  value 
and  is  an  open  research  problem  - both  as  a descriptive  problem 
and  as  a normative  problan.  More  risk  is  justified  if  the  poten- 
tial gain  is  great  enough  - pecple  don't  put  all  their  money  in 
government  securities. 

The  problem  then  beccmes  one  of  measurable  risk  and  poten- 
tial gain  and  then  the  comiander  would  decide  whether  it's  worth 
it  given  his  mission,  which  puts  boundaries  on  the  options  avail- 
able to  him. 

The  problans  of  measurable  risk  and  potential  gain  are 
exacerbrated  because  they  may  be  different  at  each  echelon  of 
conmand.  loss  of  personnel,  material,  and  terrain  are  perhaps 
weighted  differently  at  each  caimand  level. 

I'm  not  sure  that  this  approach  would  lead  to  a more  useful 
model  but  it  does  point  up  risk  taking  as  the  only  negative  var- 
iable and  the  potential  gain  as  the  positive  one. 

All  these  decisicn  models  are  sinplifications,  one  might 
say  over-sinplifications,  and  a risk  versus  gain  model  is  another 
gross  over-simplificaticn  but  it  directs  our  attention  to  seek- 
ing and  interpreting  informatics  so  as  to  bear  on  the  estimate 
of  risk  and  the  estimate  of  gain.  Then  the  trade  off  is  the 
cormander's  decision. 

One  of  the  things  I would  worry  about  in  an  expected  util- 
ity model  is  that  if  the  enany  knows  your  utilities  you  are  pre- 
dictable and  hence  more  vulnerable.  A training  program  which 
leads  to  too  great  uniformity  of  utilities  and  decision  criteria 
could  be  self-defeating. 

In  a risk-theoretic  approach  the  same  situation  in  terms 
of  outcomes  and  probabilities  would  still  leave  the  cause  of 
action  unpredictable  because  it  is  dependent  upon  the  cotinanders 
trade  off  between  risk  and  gain. 
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I«t  HE  nake  a few  remarks  stunulated  by  Dr.  JaiiES  Miller's 
talk.  Jim's  paper  was  on  a very  general  level  which  is  an 
approach  that  has  wide  applicability  but  correspondingly  less 
power.  It  doesn't  say  very  much  but  it  says  it  about  a vast 
nimber  of  things.  This  is  in  contrast  to  a more  specific  model 
viiiich  has  greater  power,  which  says  a great  deal  more  but  about 
a lot  less.  Jim  has  exercised  analogical  reasoning  by  using  all 
living  systems  as  analogies  for  each  other  and  has  abstracted 
their  universal  properties  and  processes.  The  value  of  the 
approach  lies  in  leading  one  or  guiding  one  through  a more 
thorough  analysis  of  any  one  system  and  not  missing  any  major 
aspect. 

I guess  ray  point  is  that  the  entire  spectmn  from  very  gen- 
eral to  very  specific  models  is  correspondingly  a spectmn  fron 
weak  to  strong  models  that  this  is  correlated  with  being  long- 
lived  or  short-lived  (the  more  specific  the  model  the  more  it 
will  do  for  you  when  its  applicable,  the  fewer  things  it  is 
applicable  to,  and  the  shorter  its  half-life)  and  my  point  is 
that  research  at  any  level  in  this  spectmn  is  valuable. 


RB^«RKS  ON  THE  PRESENTATION  ENTITLED 
"INTERACTION  AND  IMPACTS  IN  HIERARCHICAL  SYSTEMS" 
GIVEN  BY  T.  SAATY,  UNIVERSITY  OF  MICHIGAN 

by  ANGKIO  MIELE 
nice.  UniveMitif 


First  of  all,  I would  like  to  ccrpl intent  Professor  Saaty  for 
an  excellent  presentation  of  his  approach  to  hierarchies.  His 
approach  is  of  considerable  interest  to  ne,  since  it  might  have 
potential  interest  in  the  uevelopment  of  algorithms  for  mathema- 
tical progranming  problems  with  ineqLialily  constraints. 

Nevertheless,  a key  point  needs  clarificaticn.  In  performing 
numerical  pairwise  ocrparisons  between  conplex  activities,  prio- 
rities are  assigned  (in  accordance  with  our  feelings  and 
experience)  vdiile  using  the  sequence  of  cardinal  nuitfoers 

{ 1.2, 3, 4, 5 } (1) 

Any  subsequent  result  in  Dr.  Saaty' s presentation  seems  to  be  a 
direct  consequence  of  the  basic  assumption  (I) . 

Now,  suppose  that  priorities  are  assigned  using  sane  alterna- 
tive sequence,  for  exaiiple: 


. ,2  -2  ,2  .2  .2  , 

{ 1 ,2  ,3  ,4  ,5  , } , 

(2) 

or 

{ 1^,2^, 3^, 4^, 5^ ) , 

(3) 

or 

{ /1,/2,/3,/4,/5,  } , 

(4) 

or 

{ 1,  1+k,  l+2k,  l+3k,  l+4k,  ... 

...  } , (5) 

where  k is  seme  positive  nurrber,  for  instance, 

k = 0.5  or  k = 2. 

(6) 
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It  is  obvious  that  the  replacement  of  (1)  with  any  one  of  the 
sequences  (2),  (3),  (4),  or  (5)  would  cause  a change  in  the  con- 
clusions arrived  at  by  Dr.  Saaty.  Iherefore,  it  is  natural  to 
pose  the  follcwing  question:  vhat  is  the  sensitivity  of  the 
results  obtained  to  a change  in  the  sequence  of  mirbers  erployed 
in  the  assignment  of  priorities?  How  critically  do  the  results 
obtained  d^jend  on  the  choice  of  the  particular  sequence  (1)? 

Since  this  point  is  crucial  to  Dr.  Saaty 's  presentation,  his  views 
on  the  subject  would  be  appreciated. 
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REMARKS  ON  TOE  PRESEtTPATiaN  GIVEN  BY  C.  H.  COOMBS, 
UNIVERSITY  CF  MICHIGAN 


by  ANGELO  MIEIE 
Rice  UuLveAiity 


I Mould  like  to  state  ny  agreement  with  the  views  e^qjressed 
by  Professor  Coonbs  on  the  nature  of  scientific  research.  After 
a theory  has  been  developed  on  any  given  subject,  it  is  nice  for 
any  of  us  to  perform  e>q)eriments  confirming  the  theory.  Obvious- 
ly, this  is  good  for  our  ego.  Hovrever,  scientifically  speaking, 
it  is  even  more  important  to  perform  those  experiments  which 
might  invalidate  sane  aspects  of  the  theory  or  might  lead  to  the 
discovery  of  sane  weakness  in  the  theory.  Only  in  this  way  can 
one  hope  to  advance  the  frontiers  of  research. 

AS  scientists,  we  have  an  obligation  to  ourselves  not  to 
let  wishful  thinking  sutmerge  our  cool  professional  judgment. 

Also,  viE  have  an  obligation  toward  the  scientific  caimunity  to 
stress  both  the  good  points  and  the  bad  points  in  our  research. 
Finally,  we  have  an  obligation  to  the  goverrment  agencies  that 
stpport  our  work  to  state  the  facts  as  they  cire. 

The  philosophy  expressed  by  Dr.  Coonbs  has  been  precisely  my 
philosophy  for  a long  time.  Over  the  past  ten  years,  my  work  at 
Rice  University  has  been  concerned  primarily  with  the  develojment 
of  algoritlms  for  all  sorts  of  problems  of  applied  mathematics. 

basic  viewpoint  has  been  that  of  testing  exhaustively  these 
algorithms  in  order  to  discover  possible  weakness  and  either  (i) 
takes  steps  to  correct  these  weaknesses  or  (ii)  state  clearly 
these  weaicnesses  so  that  they  could  be  corrected  in  subsequent 
work. 

As  an  exanple  of  this  point  of  view,  I would  like  to  mention 
the  following.  At  Rice  University,  one  recent  algorithm  for  math- 
ematical programming  problems  was  tested  through  29  different 
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mmerical  exanples,  including  many  exanples  of  the  so-called 
pathological  type.  By  generating  exceptional  numerical  difficul- 
ties, we  were  able  to  arrive  at  needed  correctiwis  vAiich  increas- 
ed in  a drastic  way  the  so-called  robustness  of  the  algorithm, 
namely,  the  ability  of  the  algorithm  to  solve  the  problem  being 
considered  under  a wide  variety  of  operating  conditions. 


DISCUSSION 


Tte  foregoing  paper  was  the  theme  of  a keynote  address.  The 
discussicm  of  that  address  was  short  and  is  given  below.  It  is 
then  followed  by  a svirmary  of  a second  talk  and  a discxission. 
Lehnan:  After  26  years  with  the  Air  Force  I have  cone  to  the 
enlightenment  that  I am  a bureaucrat  - but  with  this  process  you 
can  come  up  with  answers  to  the  unanswerable  problems.  Eight 
years  ago  the  Air  Force  went  through  an  exercise  which  one  tenth 
dubbed  an  absolute  stupidity  called  TORK.  The  name  of  the  game 
was  called  "Hey  figure  out  vrfiat  tte  Air  Force  should  be  doing: 
what  are  the  inportant  missions  it  ought  to  be  under  taking  and 
give  a weighting  to  these  ventures.  He  called  these  things  000  - 
Operational  Capabilities  Objectives,  and  you  honor  the  rating 
system  such  as  if  ytxi  said  Strategic  offensive  was  number  1 and 
you  gave  it  a weighting  of  95  and  ycxi  know  Air  superiority  was 
nuirber  3 and  you  gave  it  a weighting  of  62  and  you  gave  Air  rescue 
and  Air  superiority  and  the  number  was  less  that  strategic  offen- 
sive, you  lost  strategic  offensive  before  you  did  the  other  two. 
Vfell  you  ccin  imagine  when  we  three  this  to  doctorines  and  concepts, 
they  struggled  valiantly  with  it  for  six  months.  They  finally  got 
dcwn  19  categories  that  they  would  divide  the  world  into  and  they 
could  ocme  to  absolutely  no  agreanents  on  the  numbers.  Except 
they  had  to  give  an  answer  so  they  threw  an  ansver  out  ard  this 
answer  was  sent  down  with  the  statement  - "for  the  purposes  of 
ccnputing  how  we  will  get  out  budget  for  6.2  ws  can  regard  this 
as  an  exercise".  What  you've  ccme  up  with  here  is  the  answer. 
Saaty:  The  idea  is  not  that  we  get  the  universal  answer  but  that 
we  find  out  why  we  think  the  way  we  do,  why  we  have  the  judgments 
we  have  car  why  we  get  different  answers.  We  don't  want  the  world 
to  consist  of  people  who  all  think  alike,  except  maybe  when  impor- 
tant decisions  need  majority  support.  We  want  a way  of  identify- 
ing people  and  trying  to  see  if  we  can  get  them  in  a bemgaining 
process  so  they  might  change  their  point  of  view. 
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The  authDr  gave  another  paper  which  was  an  applicatirai  of 
the  theory  to  planning.  The  hierarchy  consists  of  the  following 
levels:  The  first  or  highest  level  is  the  projected  future  of 
higher  education  in  the  U.S.  in  1985.  The  second  level  consists 
of  the  forces  vhich  shape  that  future:  eccaianic,  social,  politi- 
cal and  technological.  Following  it  is  a third  level  of  the 
actors  nanipulate  the  forces  by  pursuing  their  objectives. 

They  were:  students,  faculty,  administration,  government,  indus- 
try and  private  institutions  who  contribute  to  higher  education. 
Each  of  these  actors  has  a set  of  objectives  which  were  listed  on 
a fourth  level.  The  fifth  level  of  the  hierarchy  is  occi?)ied  by 
a set  of  seven  potential  outcomes  of  higher  education;  e.g. , the 
status  quo  (present  trends)  extended  to  1985,  elitian,  putlic 
education  for  all,  govemnent  owned  institutions,  etc.  The  out- 
comes or  scenarios  were  characterized  by  a set  of  twenty-five 
state  variables  whose  values  were  calibrated  on  a scale  from  -5 
to  5 as  they  differed  from  their  present  value,  zero,  taken  as 
the  reference  point.  Now  the  eigenvalue  method  was  applied  to  the 
hierarchy  resulting  in  a corposite  vector  for  the  scenarios. 

Linear  (in  fact  convex)  combinations  of  the  values  of  each  state 
vcuriable  over  the  scenarios  were  formed  using  the  weights  of  the 
scenarios  as  coefficients.  The  resulting  values  of  the  state 
variables  characterized  wtot  is  known  as  the  ccmx)site  soenari.o, 
the  trend  of  the  future  that  is  the  resultant  of  all  the  farces. 
This  method  of  approach  to  planning  involves  an  analysis  of  the 
beliefs  of  the  participants.  (There  were  34  people,  all  educators, 
w4x)  debated  their  judgnents  over  a period  of  about  12  liours) . It 
is  known  as  the  forward  planning  process.  Another  ijtportant  aspect 
of  planning  is  the  baclcward  process  (concerned  with  the  values  of 
the  participants)  which  begins  with  an  ideetlized  future  and  strives 
to  find  policies  for  actors  to  influence  other  actors  and  surmount 
cA>stacles  to  attain  that  future.  These  policies  may  be  incorpo- 
rated as  a new  level  under  the  objectives  of  the  actors  in  the 
forward  process  and  a new  oorposite  future  derived  to  test  the 
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effectiveness  of  the  policies  thus  developed.  Together  the  for- 
ward and  backward  processes  define  a two-point  boundary  value 
planning  prcfclem.  Iteraticn  of  the  two  processes  leads  to  a more 
realistic  assesanent  of  the  interface  between  beliefs  and  values. 
The  nunfcers  obtained  vere  very  reascnable  and  the  participants 
were  encouraged  to  find  that  there  would  be  changes  in  higher 
education  but  there  is  no  disaster  in  sight  in  any  of  the  vari- 
ables considered.  Ihe  paper  is  appearing  in  the  Journal  of  Socio- 
Eccnonic  Planning,  December  1976.  The  follcwing  disctjssion  refers 
to  both  papers. 

Question:  As  I understand  it,  vbat  you're  doing,  is,  you've  got 
an  amorphous  mass  of  data  frcm  asking  these  questions  and  this  is 
an  attempt  to  give  it  structure.  Not  give  it  structure,  but  to 
quantize. 

Saatyi  Yes.  the  numbers  are  sv^posed  to  reflect  the  structure. 
Questicni  But  really  hew  do  you  have  dynanu.es  in  this  model? 
Saaty:  By  constructing  the  problan  and  providing  judgments  to 
cover  more  than  a single  period  of  time.  The  solution  vector  will 
then  be  a function  of  time. 

Question:  Suppose  I believe  all  your  numbers.  Suppose  that  I 
agree  that  all  these  forces  are  at  play.  When  are  they  going  to 
have  the  degree  of  effect  that  you  indicate? 

Saaty:  The  method  can  only  measure  vhat  people  believe.  If  they 
are  known  to  be  good  interpreters  of  reality,  then  resiilts  should 
reflect  that  understanding  of  the  real  world. 

Question:  I thought  you  might  respond  to  a cxuple  of  questions 
from  a different  point  of  view.  Cne  question  is,  vhere  is  the 
model  of  the  process  that  is  going  on?  One  thing  we  noticed  when 
ve  were  looking  at  decision  aids  for  ONR  was  that  there  were 
really  two  quite  different  types  of  models  that  people  use  or 
find  useful.  One  is  vbere  the  nrdel  of  the  process  itself  is  in 
the  computer  or  in  the  overt  procedures.  The  other  is  vrtiere  the 
model  is  recilly  in  people's  heads.  The  procedure  that  you  are 
using  is  a way  of  organizing  or  systematically  collectirg  in  order 
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to  get  a ccaisensus  of  the  groip  vAiich  is  better  than  they  could 
produce  without  the  organizing  procedure.  It  seesns  that  what  you 
are  doing  is  an  organizing  procedure  v*iich  is  esgjloiting  the 
models  of  the  process  vJiich  are  really  in  people's  heads. 

Questicn:  Do  you  apply  the  same  kind  of  procedure  to  determine 
viien  the  trend  you  determine  is  going  to  have  its  effect? 

Saaty:  Hew  effective  plans  turn  out  depends  on  many  factors  which, 
if  represented  in  the  hierarchy,  yield  an  opportunity  to  test  sen- 
sitivity and  find  cut  where  to  put  one's  greatest  efforts  to  bring 
about  a desired  outcome. 

aaesticn:  On  Thursday,  you  applied  it  to  your  sen's  choice  of 
school.  You  seaned  to  be  satisfied  that  he  had  an  adequate  grasp 
of  vhat  he  really  was  happy  or  unhappy  about.  Was  the  itcdel  used 
in  your  decision,  or  was  that  just  an  exercise? 

S3aty;  Yes.  The  son  was  taken  out  of  that  schcxDl  as  a consequence 
of  the  model,  tty  wife  vho  participated  in  the  exercise  and  had 
preferred  school  B,  was  also  convinced  of  the  result.  A student 
of  mine  vho  had  finished  his  vrork  chose  his  job  by  a similar 
approach.  When  his  boss  quit  that  working  place,  a factor  which 
he  hadn't  considered  in  his  hierarchy,  he  went  to  work  at  the 
secOTKd  choice  job. 

Question:  I was  wondering  what  your  definitions  of  the  lantxia's 
were  in  the  consistency  test.  You  had  lambda  max  - n over  n on 
the  board.  Was  that  what  these  lambda's  were? 

Saaty:  The  lambda's  are  an  indication  of  how  consistent  the 
numerical  data  are.  If  lambda  max  - n turns  out  to  be  large  then 
what  you  have  to  do  is  revise  the  judgments  by  greater  familiarity 
wdth  the  problan  which  can  involve  delays  to  leauoi  more  about  it. 
Oie  wey  to  test  how  good  the  data  are  is  to  compare  this  index 
wd.th  its  average  value  from  matrices  of  the  same  order  whose 
entries  aire  randomly  chosen  frein  the  scale  1-9. 

Ojesticn:  You  had  a perfect  one  on  there  once,  in  the  two  dimen- 
sional case.  The  two  dimensional  case  always  has  to  be  perfect. 
Saaty:  It  always  has  to  be  consistent. 
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we  are  looking  for  the  independence  properties.  However,  there 
is  also  a way  in  vhich  one  can  include  dependence  in  a way  similar 
to  generating  input-output  relations.  What  one  does  is  to  use  for 
the  criteria  or  properties  each  one  of  the  activities  themselves. 
And  then  one  measures  hew  activity  A cenpares  with  activity  B as 
far  as  the  functioning  or  productivity  of  each  cne  of  thu.i  xs 
ccaicemed.  This  leads  to  a matrix  of  pairwise  ccrpariscxis  vhose 
eigenvector  yields  a measure  of  the  dependence  of  cxie  industry  on 
all  others.  In  this  irenner  we  obtain  a matrix  of  eigenvectors. 

It  can  be  weighted  by  the  "independence"  priority  vector  of  the 
industries  to  obtain  a joint  interdependence  vector  - the  cne  you 
are  looking  for. 

Question ; Have  you  had  the  opportunity  to  work  this  hierarchical 
exercise  as  you  did  with  the  educators  with  two  different  groups 
of  people  in  the  same  business  to  see  what  sort  of  consistency  of 
projections  you  get?  What  are  the  results? 

Saaty : Of  course,  even  having  only  one  audience  of  independently 
minded  pecple  who  carry  out  a heated  debate  over  their  judgments 
is  a good  enough  exaitple.  Each  participant  attarpts  to  influence 
the  outceme  according  to  his  strength  with  the  group.  A very 
strmg  minded  individual  can  deminate  the  grorp  and  bias  the  out- 
ocme  in  his  favor.  The  audience  must  be  alerted  cpenly  to  this 
possibility.  If  individuals  conduct  the  process  separately,  one 
may  ebtain  ocnsaisus  by  averaging  over  their  resulting  solutions. 
Hewever,  grexp  participation  is  best  when  none  of  the  people  is 
an  expert. 

Question:  It  seems  to  ne  this  might  be  a way  to  rationalize  the 
requiresnents  generation  process  which  is  sometimes,  in  the  aggre- 
gate, not  a very  rational  process. 

Miele:  If  my  understanding  is  correct,  you  are  cciiparing  a cer- 
tain nuitber  of  items  from  the  point  of  view  of  certain  categories 
of  things  that  you  have  recorded.  Prom  the  lecture  of  the  other 
day,  I remember  that  you  used  a system  of  cardinal  nutbers  to 
order  the  relative  inportance  of  the  things.  Obviously,  this  was 
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a kind  of  arbitrary  assuirpticn.  SuHx>se  I order  the^  relative 
iitportance  of  the  things  in  a different  way?  Suppose  I say  I 
don't  want  to  use  the  number  1,  2,  3 but  rather  the  squares  or 
cubes  of  these  numbers.  How  sensitive  is  the  answer  you  get  to 
this  basic  assuiption? 

Saaty:  In  fact,  the  other  day  I failed  to  tell  you  that  the  most 
fascinating  thing  abcut  this  is  that  these  numbers  are  cardinal 
numbers.  I shewed  that  if  ycu  put  cardinal  ratios  in  the  matrix, 
you  recover  the  scale  by  solving  the  eigenvalue  problem.  Then  I 
said  that  when  people  provide  judgnents,  they  will  usually  get 
inconsistencies  around  these  numbers.  I wanted  an  aggregate  mea- 
sure of  hew  well  they  are  doing.  The  expert  will  give  me  a lambda 
max  near  to  n.  Presumably,  the  inexpert  will  have  larger  devia- 
tions. So  vbat  we  are  doing  is  to  obtain  estimates  of  an  under- 
lying ratio  scale.  The  scale  1-9  has  been  tested  in  a variety  of 
examples  against  25  other  scales,  in  matrices  whose  entries  were 
given  qualitatively  according  to  the  scale.  It  yields  a better 
representaticn  of  the  underlying  scale  using  root  mean  square, 
median  absolute  deviation  about  the  median  as  measures  than  the 
other  scales. 

Welch:  Wherever  you  have  1,  2,  3,  4,  replace  those  by  another  set 
of  numbers  that  are  still  ordered  by  make  a one  to  one  substitu- 
tion. What  happens  to  the  mathematics? 

Saaty:  You  dcxi’t  get  as  good  an  ansvrer.  In  fact,  for  most  sub- 
stitutions you  will  get  an  unsatisfactory  estimate  of  the  under- 
lying scale. 

Welch:  But  have  you  ever  tried,  say,  1,  1.1,  1.2?  What  happens 
then? 

Saaty:  What  would  be  desirable  would  be  that  both  the  numbers  and 
their  reciprocals  be  far  enough  ^>art  so  that  they  would  be  a true 
representation  of  your  feelings.  We  have  error  here.  If  we  make 
an  error  in  jxxigment,  we  don't  vrant  to  mix  that  with  distinguishing 
between  one  judgment  and  the -next  one.  I tried  1+e  and  1/(1+e) . 

It  seems  to  me  that  you  cannot  distinguish  between  1+e  and  l/(l+e) 
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very  v«ll.  In  other  words,  the  property  and  its  inverse  would  be 
about  the  same.  You  have  to  separate  them  adequately. 

Welch:  I was  trying  to  separate  the  question  between  the  judg- 
maits.  I'm  perfectly  h^jpy  to  do  it  that  way.  Then  just  crank 
ttuough  the  itHthematics  of  the  different  scales. 

Thrall:  It's  clear  that  if  you  took  the  numbers  1,  2,  3,  4 and 
then  the  next  ones  were  51,  52,  53,  54,  you  can  start  to  see  the 
problems.  I think  this  is  pretty  obvious.  You  are  going  to 
weigh  everything  in  terms  of  those  cbher  tings  and  the  first  ones 
are  going  to  count  liloe  zero.  But  if  you  had  1,  3,  5,  7,  instead 
of  1,  2,  3,  4,  that  probably  wDuldn't  make  any  vast  difference. 

The  question  you  ask  is  really  one  that  hasn't  been  investigated. 
Saaty:  Let  me  tell  you  why,  for  example,  1 to  100  doesn't  work 
well.  When  people  have  many  numbers  to  choose  from,  they  start 
changing  their  minds  by  several  integers  on  the  lower  end  of  the 
scale.  To  go  from  3 to  a 7 on  a 1 to  100  scale  means  that  one  is 
changing  one's  judgment  of  the  straigth  of  dominance  by  7/3  or 
2-1/3.  Going  from  40  to  50  iiiplies  a change  of  5/4  although  it 
involved  adding  10  points.  The  scale  offers  great  opportunity 
for  biasing  the  results. 

&jesticn:  I would  like  to  suggest  a very  simple  answer  to  all 
of  this.  Out  of  the  simple  cardinal  numbers  from  1 to  7 and  their 
combinations  and  fractions,  you  can  build  up  a ratio  from  7 to  1 
and  1 to  7,  and  almost  anything  in  between  with  increments  which 
cire  appropriate  to  human  judgment.  If  you  go  to  much  larger 
numbers,  you  get  much  amaller  increments  and  nobody  can  judge 
that  finely.  It  gives  you  a sufficiait  feel  to  express  feelings. 
Any  time  you  are  not  consistent  in  the  choosing  of  the  relative 
weights,  in  each  of  your  rows,  you  will  get  an  inconsistency. 

And  the  aggregate  of  that  is  reflected  in  increase  of  lambda  over 
N.  If  you  are  perfect  in  your  judgments  and  the  expressions  of 
ycur  judgments,  you  will  always  have  lambda  equal  N. 

Question:  I would  like  to  ireke  the  cbservaticn  that  independent 
of  the  numbers  and  the  method  you  are  going.  I am  reminded  that 


at  the  Philadelphia  ORSA  meeting  there  were  several  p^jers  direc- 
ted at  recovering  structure  fron  this  kind  of  data.  One  asked 
people  to  draw  a map  of  South  America  based  cxi  how  far  away  they 
remambered  Argaitina  was  frcm  Chile  and  so  on.  You  have  a nethod 
it  appears  that  vAiat  the  way  you  could  use  this,  indepen- 
dent of  the  method  you  chose,  was  to  ask  people  to  construct  a 
ocnmand  and  control  network  as  they  perceive  it.  They  ccnpare 
that  with  the  physical  camand  and  control  network  that  actually 
exists.  Try  to  uncover  viiat  it  is  that  is  causing  this  disquiet 
about  whether  it  works  or  doesn't. 

Question:  Another  cdiment  about  the  scaling  of  the  numbers. 

Don't  forget  that  the  purpose  of  all  this  is  do  disambiguate  our 
own  thinking  vtere  our  own  ability  to  project  is  screvrtiat  fuzzy. 
If  it  becomes  clear  that  cur  factor  is  100  times  more  ijiportant 
than  another,  then  that  becomes  an  assurtption.  That  doesn't  go 
into  the  table  at  all.  Where  Dr.  Saaty's  techniques  seem  to  have 
relevance  is  in  the  fuzzy  in  between  area.  It  is  reasonable  that 
the  nmfciers  are  in  a fairly  narrow  range. 
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SOME  STATISTICAL  PROBLEMS  IN  LOGISTICS  RESEARCH 
AND  MILITARY  DECISION  PROCESSES* 

by  S.  ZACKS 

Cdie  Ue.itcA.li  ResttAi’T.  UtUve-uitij** 


Abitlact.  The  present  paper  discusses  sane  problems  of  large 
systans  logistics  and  tactical  decision  processes  Vi^ch  require 
the  development  of  proper  statistical  theories  and  methods.  The 
discussion  is  focused  on  three  problem  areas:  statistical  con- 
trol of  two-echelon  multi -station  inventory  systans;  statistical 
manpcwer  forecasting  and  survival  distributions  in  crossing  mine 
fields.  The  discussiai  is  general  but  specific  numerical  exanples 
are  provided  to  illustrate  the  ideas. 

1.0  hitAoduction.  Logistics  research  covers  many  different  areas 
related  to  problems  of  designing  and  controlling  large  dynamical 
systems.  In  recently  published  books  [3,  6]  one  can  find  several 
good  discussions  of  these  problem  areas  and  the  modem  trends  in 
logistics  research.  This  research  is  carried  for  tte  purpose  of 
developing  efficient  management  procedures  of  the  total  sipport 
functions  of  large  systems.  We  include  today  among  these  func- 
tions not  only  the  traditional  ones,  namely:  design  of  facili- 
ties; production  planning  and  control,  assignment  and  allocation 
problems,  inventory  control,  transportation  and  others  but  also 
problems  areas  ooncemed  with  the  reliability  and  maintainability 
of  veapon  systems;  tactical  mini-  and  maxi-ccmbat  problems,  etc. 

In  all  the  areas  mentioned  above  statistical  research  occupies  a 

* Prepared  for  the  Workshop  on  Decision  Information  for  Tacrtical 
Carmand  and  Control,  22-25  September  1976,  Airlie,  Virginia. 

**  Sup^»rted  by  the  Offion  of  Naval  Research  under  Contract 
NR  00014-75-C-0529,  ProjeoTt  NR  -42-278,  at  Case  Western  Reserve 
University;  and  under  ContraoA  NR  00014-75-C-0729,  Project 
NR  -47-020  at  the  George  Washington  University. 
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central  position.  One  can  find  hundreds  of  papers  that  have  been 
written  on  various  stochastic  and  deterministic  optimization 
methods  in  each  one  of  the  areas  mentioned  above.  Not  much  is 
available,  however,  in  the  literature  on  statistical  theories  and 
methods.  This  is  partly  due  to  the  complexity  of  the  problems  and 
partly  to  the  widespread  practice  of  applying  the  established 
"optimal"  procedures  in  which  sinple  estimates  of  the  unknown 
parameters  are  substituted.  In  many  cases  such  a sinple  approach 
yields  adequate  results.  It  cannot,  hovrever,  be  always  recaimen- 
ded,  as  will  be  discussed  later. 

The  objective  of  the  present  paper  is  to  expose  and  discuss 
sane  statistical  problems,  which  the  author  has  stuiied  in  the 
past,  and  to  indicate  fruitful  problan  areas  for  further  research. 
In  our  esposition  we  will  discuss  the  following  problems: 

1)  Statistical  control  of  two-echelon  multi-staticn  inven- 
tory systems; 

2)  Adaptive  manpx3V\er  forecasting  model; 

3)  Strategies  of  crossing  mine-fields. 

These  problem  areas  are  not  the  only  interesting  ones.  There 
are  other  interesting  statistical  problems  in  the  field  of  logis- 
tics research,  like  problems  of  evaluating  the  readiness  of 
systems,  reliability  estimation,  sequential  determination  of 
surveillance  epochs  and  others.  For  sane  discussion  of  these 
problems  see  Chapter  10  of  Modem  Trends  In  Logistics  Research 
[6]. 

2.0  Two-Echelon  Mutti-St£UA.on  lnvznto>iij  Problem.  In  the  pre- 
sent section  we  give  an  example  of  a complicated  inventory  con- 
*-rol  problem  vhich  requires  statistical  techniques,  since  the 
information  on  the  dertand  distributions  is  incoiplete.  The 
problan  vre  consider  is  that  of  determining  optimal  stock  policies 
in  a two-echelon  multi-station  model,  designed  for  naval  applica- 
tions. The  two  echelons  under  consideration  are  the  depot,  D 
(upper)  and  tender-ships,  Tj^,...,Tj^  (lower).  The  custoners 
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arriving  at  the  stations  are  svihrarines.  We  assume  that  the 
nonthly  demand  for  a specified  item,  at  station  is  a random 

Vciriable  X^,  j = 


Figure  1.  Inventory  flew  in  a two-echelon  multi-station  model. 


The  flew  of  material  in  the  system  is  described  in  Figure  1.  The 
stations  can  order  from  the  depot,  D,  at  the  beginning  of  the 
n-th  month  a quantity  Y , or  could  send  back  to  the  depot 


unneeded  stock.  If  O . denotes  the  stock  level  at  T.  at  the 

n,a  ] 

beginning  of  the  n-th  month  then  Y . > -o  for  all 

n,3  — ^,3 


j = l,...,k.  Moreove: 


■f  y Y^  . < V , vdiere  Y^  = max(0,Y)  and 
j=l  ~ " 


designates  the  stock  level  at  the  depot  at  the  beginning  of 

the  n-th  month.  The  depot  orders  from  the  manufactures  at  the 
beginning  of  the  n-th  month  a quantity  2^^,  which  arrives  at  the 

depot  only  I months  later.  The  lead-time  between  the  v?)per  and 
the  lc>^  echelons  is  one  month.  The  objective  is  to  determine 
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at  the  beginning  of  each  month  order  levels  ^^n'^n,l' ’ ' ‘ '^n,k^ 


so  that  the  expected  total  lower  echelon  cost 

= ^y^i^Qn,!  - ^n,i>"  ^ ^i<Qn,i  ' ^n, 


:)  } 


will  be  nvinijTiized  and  the  probability  that  at  each  month  the  depot 
will  be  able  to  satisfy  the  dejnand  of  the  stations  will  not  be 
sitBller  than  a preassigned  tolerance  level  y.  Zacks  and  Fennell 
[11,121  studied  the  problem  vihen  only  partial  information  on  the 
distributions  of  the  danand  variables  X X , is  available. 

Bayes  adaptive  control  procedures  were  developed.  These  proce- 
dures determine  after  every  month,  according  to  the  total  obser- 
ved demaivi  at  each  station,  the  predictive  distributicxi  of  the 
future  daiand  Vciriables.  The  predictive  distributions  obtained 
frcm  the  Bayesian  model  are  negative  bincrual  with  adaptively 
changing  parameters.  The  negative  binonial  distributions  were 
previously  fitted  by  Haber  and  Sitgreaves  [4]  to  the  demand  for 
repair  parts  in  the  Polaris  fleet.  Such  distributicns  were  also 
fitted  by  Denikoff,  Fennell,  Haber  and  Solomon  [2].  It  was 
shown  in  ttese  previous  studies  that  the  negative  binomial  distri- 
butions, which  depend  on  two  parameters,  can  provide  an  adequate 
fit  to  the  denand  distributions,  which  depend  on  two  parameters, 
can  provide  an  adequate  fit  to  the  danand  distributions  of  most 
classes  of  items  in  the  submarine  fleet.  In  the  Bayesian  model, 
if  we  assume  that  demand  variables  Xj^,X2...,  for  a certain  part, 

at  different  months  are,  conditionally  an  9,  independent  and 

identically  distributed  having  a Poisson  distribution  wdth  monthly 

average  0,  and  if  9 has  a prior  ganma  distribution,  G(y  v), 

n 

then  the  expected  distribution  of  given  that  I X^  = T^, 


is  the  negative  bincmial  distribution  with  p.d.f. 
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r(Vnti) 

4(1 

L^n'  ''n' 

r(i+l)  r(vj^) 

with  \if 

n 

_ T 

and 

1 + (n+l)T 

This  distribution  is  called  the  predictive  distribution  of 

given  the  past  history  of  the  demand.  The  model  is  thus  much  more 
flexible,  since  the  predictive  distributicns  applied  for  the 
determination  of  the  optimal  stock  levels  are  not  the  same  every 
month,  but  keep  adapting  to  the  actual  results.  Algorithms  for 
the  determinaticn  of  the  optimal  order  levels  at  the  Icwer  echelon 
and  the  upper  echelon  were  developed.  For  the  proof  of  optimality 
of  the  overall  procedure  see  Zacks  [8].  The  cost  function 
C(j^,  X^)  looks  sinple  enough,  but  due  to  the  structure  of  the 

inventory  flow,  the  determinatic*  of  the  order  vector  Y should 


minimize  the  expectation 


R(Y  ;Q  ) = y 

n'“n' 


E.  {c. [ (Q  . + Y 
i,n  n,i  n. 


Vi,i> 


+ Y 


n,i 


- 

n,i 


Vi,ii"»- 


This  is  the  expected  cost  due  to  shortage  or  excessive  stock  at 

the  end  of  the  (n+l)st  month,  ccnputed  according  to  the  predictive 

distributicn  of  X and  X . , . , determined  at  the  end  of  the 
n,i  n+1,1 

(n-l)st  month.  The  program  for  the  determinaticn  of  the  optimal 
Y is  not  too  coiplicated  and  the  ccmputaticns  cure  quite  fast. 

On  the  other  hand,  the  determination  of  the  optimal  upper  echelon 
ordering,  Z^,  for  a lead-time  of  f = 2 months  requires  to  find, 

at  the  end  of  the  (n-l)st  month  the  smallest  integer  z vhich 
satisfies  the  inequality 


P{z+Z. 


,+V  > 

-1  n — 


k 

I (y 

i=l 


.+Y 
n,i  • 


n+l,i^^^^2^^*^n+2,i”®n+2,i^  l^n-1^  _>y' 
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where  (*^+2  i ” '^n+l  desirable  ordering  level  of  the 

i-th  station  two  months  in  the  future.  This  conditional  prob- 
ability, which  depends  on  the  total  observed  denand,  at  all 

the  k stations  during  first  n-1  months,  is  a very  conplicated 
predictive  distribution.  In  order  to  approximate  it  by  simpler 
predictive  distribptions  we  have  performed  extensive  simulations 
of  such  systans,  with  the  exact  amputations  of  the  values. 

In  the  following  table  wa  illustrate  a Six-station  case  where  the 
demand  variables  at  each  station  are  independent  Poisson  with 
different  ireans,  X. 


Table  1.  The  parameters  of  a S-staticxi  system. 
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Table  2.  A 12-nonths  simulation  of  a 6-staticn  system. 


n 

Ql 

^2 

^3 

Q4 

Q5 

Qe 

^1 

^2 

^3 

^4 

^5 

^6 

V 

Z 

COST 

1 

0 

2 

4 

6 

8 

10 

5 

0 

0 

0 

0 

0 

5 

62 

108 

2 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

314 

3 

0 

0 

0 

0 

0 

0 

10 

10 

7 

10 

11 

14 

62 

63 

94 

4 

9 

6 

2 

1 

0 

0 

0 

0 

0 

0 

0 

7 

7 

12 

312 

i 5 

9 

0 

0 

0 

0 

0 

0 

10 

9 

10 

15 

19 

63 

66 

86 

' 6 

6 

2 

0 

1 

3 

4 

0 

0 

0 

0 

0 

12 

12 

19 

252 

7 

4 

0 

0 

0 

0 

4 

3 

10 

10 

12 

15 

16 

66 

68 

120 

8 

5 

7 

2 

4 

7 

9 

0 

1 

0 

3 

6 

9 

19 

19 

98 

1 9 

3 

4 

0 

0 

2 

14 

5 

8 

13 

15 

16 

8 

68 

65 

202 

^ 10 

7 

9 

11 

4 

10 

11 

0 

0 

0 

9 

5 

8 

22 

21 

252 

11 

6 

4 

9 

5 

7 

6 

2 

7 

2 

10 

11 

17 

65 

49 

200 

12 

5 

9 

0 

8 

8 

17 

2 

2 

12 

7 

9 

5 

37 

38 

156 

This  table  shows  that  after  a few  months  of  oorrecting  a systan 
which  is  ill  conditioned,  the  system  stabilized,  and  the  optimal 
Zjjj  values  are  approxinately  equal  to  the  sun  of  the  values 

only  for  several  months.  We  have  also  shown  in  [11]  that  the 
and  values  vhich  are  determined  by  using  Poisson  distribu- 
tions with  estinates  of  the  X values,  yield  average  monthly  cost 
larger  than  the  ones  ctotained  by  the  Bayes  adaptive  procedure. 

This  illustrates  veil  the  need  for  the  development  of  proper 
statistical  procedures. 

3,0  Adaptivz  ManpoweA  fomautinq  Models . In  the  present  exairple 
we  would  like  to  present  a forecasting  problan  which  does  not 
belong  to  the  cleiss  of  problems  which  are  suitable  to  the  coimonly 
used  time-series  forecasting  like  those  discussed  by  Box  and 
Jenkins  [1].  The  problem  is  that  of  periodic  forecasting  of  the 
total  size  of  the  Marine  Corps,  cind  the  size  of  certain  parts  of 
the  force.  The  need  for  a statistical  method  of  forecasting  the 
size  of  the  force,  despite  the  fact  that  individuals  belonging  to 
the  force  sign  service  contracts,  is  due  largely  to  the  problems 
of  random  attrition.  This  attrition  is  not  of  constant  propor- 
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tions  at  every  time  period  and  at  different  units  of  the  forc3e. 
Withdravel  from  service  amonq  the  career  force  personnel  is  of 
different  characteristics  than  that  of  first  enlistees.  The 
factors  which  significantly  affect  the  attrition  of  the  first- 
term  enlistees  were  studied  by  Haber  (41.  It  was  found  that 
among  many  different  possible  factors  the  ones  v4iich  significant- 
ly influence  the  retention  rates  are:  length  of  ccxitract,  year  of 
entry  to  the  force,  education  and  race.  These  factors  are  not 
independent;  moreover,  the  year  of  entry  to  the  force  is  an 
inportant  variable  because  many  of  other  possible  factor  of 
apparent  theoretical  iitportance  (econonical,  sociological,  psycho- 
logical and  political)  are  actually  time  dependent.  Thus,  if  we 
classify  the  individuals  according  to  the  year  and  quarter  of 
entry,  length  of  contract,  education  (less  than  high  school,  at 
least  high  school)  and  race  (white  and  non-vhite)  all  the  other 
factors  do  not  contribute  significantly  to  the  iirprovement  of  the 
forecasting.  On  the  other  hand,  different  peurts  of  the  career 
force  show  high  similarity  of  retention  rates.  It  was  found  that 
one  retentiai  rate  can  be  used  for  the  whole  career  force  at  each 
forecasting  period.  The  career  force  rates  shaws  also  small  vari- 
ability over  time. 

The  methodology  of  forecasting  applied  in  our  studies  is 
based  on  the  estimation  of  tie  retention  probabilities  of  certain 
sufcpcpulations  over  the  last  quarter,  and  determining  prediction 
(or  tolerance)  intervals  having  the  characteristic  that,  with  con- 
fidence prctobility  (1-a)  we  cinticipate  the  size  of  the  grotps 
under  consideratioi  to  belong  at  the  end  of  the  next  quarter  to 
the  intervals.  Several  methods  of  determining  the  predicticn 
intervals  were  ccrpared. 

In  the  following  table  we  illustrate  the  prediction  intervals 
determined  by  three  methods  (conditional  maximun  lilcelihood  - CMLE; 
tolerance  limits  and  Bayes  prediction  limits)  as  determined  cm 
actual  Marine  Corps  data. 
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Table  3.  Prediction  limits  for  the  size  of  cohorts  on  July  2,  1972 
( = .05).  Forecasting  on  January  1,  1972. 


i 

j 

k m 

CMLE 

Tolerance 

Bayes 

Actual 

1 

1 

1 

1 

1401. 

1434. 

1382. 

1446. 

1393. 

1439. 

1418. 

1 

1 

2 

1 

507. 

520. 

496. 

523. 

502. 

521. 

499. 

1 

2 

1 

1 

3272. 

3303. 

3253. 

3315. 

3264. 

3307. 

3280. 

1 

2 

2 

1 

676. 

693. 

665. 

697. 

671. 

694. 

674. 

2 

1 

1 

1 

935. 

979. 

912. 

997. 

926. 

986. 

1009. 

2 

1 

1 

2 

876. 

916. 

855. 

932. 

867. 

922. 

910. 

2 

1 

1 

3 

1133. 

1165. 

1115. 

1177. 

1125. 

1170. 

1155. 

2 

1 

2 

1 

113. 

130. 

103. 

136. 

109. 

132. 

135. 

2 

1 

2 

2 

98. 

111. 

89. 

114. 

94. 

112. 

104. 

2 

1 

2 

3 

158. 

169. 

149. 

171. 

154. 

170. 

163. 

2 

2 

1 

1 

1973. 

2009. 

1952. 

2023. 

1964. 

2014. 

2019. 

2 

2 

1 

2 

2277. 

2309. 

2257. 

2322. 

2269. 

2314. 

2301. 

2 

2 

1 

3 

1112. 

1133. 

1099. 

1140. 

1106. 

1136. 

1121. 

2 

2 

2 

1 

246. 

260. 

235. 

264. 

241. 

261. 

256. 

2 

2 

2 

2 

223. 

236. 

214. 

239. 

219. 

237. 

230. 

2 

2 

2 

3 

171. 

181. 

163. 

183. 

167. 

182. 

177. 

3 

1 

1 

1 

1467. 

1518. 

1440. 

1540. 

1456. 

1527. 

1570. 

3 

1 

1 

2 

1692. 

1749. 

1663. 

1773. 

1630. 

1758. 

1781. 

3 

1 

1 

3 

2261. 

2325. 

2223. 

2352. 

2247. 

2335. 

2347. 

3 

1 

1 

4 

2554. 

2616. 

2522. 

2643. 

2541. 

2627. 

2633. 

3 

1 

1 

5 

2952. 

3001. 

2924. 

3022. 

2940. 

3010. 

2979. 

3 

1 

2 

1 

147. 

166. 

136. 

173. 

142. 

169. 

165. 

3 

1 

2 

2 

167. 

187. 

156. 

194. 

162. 

190. 

190. 

3 

1 

2 

3 

266. 

291. 

252. 

300. 

260. 

294. 

292. 

3 

1 

2 

4 

279. 

300. 

266. 

207. 

274. 

302. 

294. 

3 

1 

2 

5 

391. 

404. 

380. 

403. 

386. 

405. 

386. 

3 

2 

1 

1 

3333. 

3379. 

3307. 

3399. 

3322. 

3387. 

3403. 

3 

2 

1 

2 

4623. 

4676. 

4594. 

4699. 

4611. 

4685. 

4675. 

3 

2 

1 

3 

3380. 

3427. 

3354. 

3447. 

3369. 

3435. 

3416. 

3 

2 

1 

4 

4115. 

4159. 

4090. 

4177. 

4104. 

4166. 

4108. 

3 

2 

1 

5 

3207. 

3240. 

3187. 

3252. 

3199. 

3245. 

3207. 

3 

2 

2 

1 

331. 

348. 

319. 

353. 

325. 

350. 

345. 

3 

2 

2 

2 

431. 

452. 

417. 

459. 

425. 

455. 

451. 

3 

2 

2 

3 

411. 

432. 

397. 

440. 

405. 

435. 

428. 

3 

2 

2 

4 

466. 

488. 

453. 

496. 

460. 

491. 

478. 

3 

2 

2 

5 

526. 

540. 

516. 

544. 

522. 

541. 

526. 

Sums 

48170 

49249 

47537 

49656 

47902 

49404 

49130 

In  the  above  table,  the  index  i (i=l,2,3)  designates  the  three 
types  of  contracts  (2,3,4  yrs).  The  index  j (j=l,2)  designates 
the  race  (W,n-W) . The  index  k ()c=l,2)  designates  the  educa- 
tion {IilS,AHS)  and  the  index  m designates  the  time  of  enter- 
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ing  the  force  according  to  the  following  code: 


1 

m 

Entry 

1 

1 

Jan.  1971 

/ 2 

1 

Jan.  1970 

2 

July  1970 

1 

3 

Jan.  1971 

3 

1 

Jan.  1969 

2 

July  1969 

3 

Jan.  1970 

4 

July  1970 

5 

Jan.  1971 

If  we  denote  by  the  size  of  the  (i, j,k,in)-th  sub- 

population after  t periods  (of  six  months)  then  the  basic 
theoretical  model  is  that,  for  each  such  subpc^julation  the  condi- 
tional distribution  of  X^jj^(t)  given  X^j^(t-l)  is  the 

binonial,  vhere  is  the  reten- 

ticHi  probability  for  the  subpc^lation  during  the  t-th  period. 

The  CMLE  method  provides  (1-a) -prediction  intervals  for 
Xij)^(t),  given  X^jj^(t-l),  when  the  retention  probabilities  eure 

estimated  fron  the  data  by  the  conditional  maximun  likelihood 
estimators.  The  tolerance  limits  and  the  Bayes  limits  are  con- 
structed by  considering  first  the  2ARCSIN(»'6)  transformation; 


This  transformation  has  desirable  characteristics  in  terms  of 
variance  stabilization  even  for  medium  size  sanples.  Vte  will  not 
provide  here  the  derivations  and  the  fonnulcie  of  the  prediction 
limits.  The  interested  reader  is  refered  to  Zacks  and  Haber  (14). 
Total  force  forecasting  procedures  were  applied  by  the  Marine 
Corps  following  the  technical  paper  of  Zacks  (10].  The  nethod 
was  also  applied  to  a problem  of  forecasting  the  retention  of 
. Navy  pilots. 
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4.0  Sfuiteq-iu  oj  C^066-inq  Him  F-ieXcU.  The  study  on  strategies 
of  crossing  mine  fields  was  performed  in  1963-1966  (see  Zacks  and 
Goldfarb  [11]  cind  Zacks  [8])  and  renewed  recently  in  a new  study, 
Zacks  [15].  The  preplan  can  be  described  in  the  following  terms. 

A nixnber  of  clusters,  k,  containing  mines,  are 

distributed  randotay  over  a (rect£ingular)  field  of  specified 
dimensions.  The  centers  of  the  clusters  , . . . , 

are  given  and  the  specific  bivariate  distribution  functions, 
according  to  which  the  mines  in  each  cluster  are  distributed, 
are  given  too.  The  problem  is  to  determine,  for  any  specific 
breaching  path,  the  survival  prc^Dabilities  of  each  one  of  n 
targets  (personnel,  vehicles  or  tanks)  crossing  in  a colunn  at 
the  same  path;  under  the  following  assumptions: 

(i)  the  encounters  of  targets  and  mines  are  conditionally 
independent  of  the  prior  events; 

(ii)  with  probability  p^^^  a mine  is  detected  and  des- 
troyed by  the  target; 

(iii)  an  activated  mine  destroys  the  target  only  with  prob- 
ability Pj^; 

(iv)  a target  passing  the  neighborhood  of  a mine  activates 
it  with  probability  p . 

The  parameters  Pj.  and  are  specific  to  the  type  of 

target  crossing  the  field  and  the  type  of  mine  used. 

The  survival  probabilities  of  the  targets  crossing  in  a 
coliatm  depend  in  addition  on  the  nunber  of  mines  in  the  path. 

This  is  an  unknown  variable,  whose  distribution  can  be  often 
c^rosdmated  by  a Poisson  distributicn,  wdth  parameter,  X,  which 
depends  on  the  location  of  the  path  relative  to  the  centers  of 
the  k clusters;  on  the  nurber  of  mines  and  on  the 

particular  distributions  of  the  clusters.  In  a recent  paper 
Zacks  [15]  provided  fontulae  for  the  determination  of  the  peirameter 
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A when  the  cluster  distributions  are  bivariate  nonral,  ard  an 
algoritlir.  for  the  recursive  (exact)  determination  of  the  survival 
probabilities.  In  the  previous  papers  of  Zadcs  a«3  Goldfarb  [ 11  ] 
and  of  Parsons  [ 7 ] closed  form  formulae  were  provided  for  the  sur- 
vival probabilities  in  the  speical  case  of  no  possible  detection 
(Pjjet  ~ every  activaticxi  destroys  the  target  (pj^  = 1) . 

Closed  analytic  formulae  can  be  derived  also  in  the  present  gen- 
eral model.  They  are  however,  of  no  speical  interest,  because 
the  corputation  time  required  is  trivial.  The  procedure  developed 
by  Zacks  in  [15]  has  been  already  appied  by  TRASANA  at  the  White 
Sands  Missile  Base  for  the  solution  of  various  problems  in  the 
evaluation  of  new  weapon  systems. 

5.0  fxompfe.  Consider  a square  mine  field  of  dimensicxis  200m  x 
200m.  Nine  clusters  of  N = 50  mines  are  distributed  over  the 
field  around  the  center  points  with  coordinates  = 50,  100, 

150  m and  = 50,  100,  150  m (i  = 1,2,3).  Each  cluster  is 

distributed  according  to  a bivariate  normal  distribution  around 

its  center  point  with  variances  = 81.25  m^,  = 43.75  m^ 

and  correlation  P = .5447.  Such  a distribution  is  obtained  Ipy  a 
9 = 30°  rotation  of  a bivariate  nornial  distribution  with  = IQm, 

Oy  = 5m  and  p = 0. 
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Figure  2.  Ellipsoids  of  concentration  of  scatter  distributions. 


We  consider  straight  breaching  paths  of  width  Im.  We  cotpute  j 

first  the  probability  j , that  a mine  belonging  to  cluster  j 

(i,j)  will  fall  in  the  breaching  path.  The  distributicxi  of  the  j 

number  of  mines  in  the  path  is  approximated  by  a Poisson  distri-  ] 

3 3 

bution  with  mean  X*  = 50  I I ii>.  ..  Following  the  algorithm  I 

i=l  j=l  I 

developed  in  [15]  vre  can  determine  the  expected  numter  of  survi-  ] 

vors  in  a column  of  n.  In  the  following  table  we  provide  the  i 

1 

values  of  X*  and  expected  survivors  in  20  paths  located  B m j 

fron  the  center  of  the  field.  ] 
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Table  4.  Expected  nuniber  of  survivors  in  columns  of 
n=10,  Pact^-95,  P,^=.7/  Pdud"-2/  n=D0. 


B 

A* 

E{X  } 
n 

-95. 

0.000 

10.000 

-85. 

0.003 

9.999 

-75. 

0.114 

9.953 

-65. 

1.331 

9.452 

-55. 

4.552 

8.127 

-45. 

4.552 

8.127 

-35. 

1.334 

9.451 

-25. 

0.228 

9.906 

-15. 

1.334 

9.451 

- 5. 

4.552 

8.127 

5. 

4.552 

8.127 

15. 

1.334 

9.451 

25. 

0.228 

9.906 

35. 

1.334 

9.451 

45. 

4.552 

8.127 

55. 

4.552 

8.127 

65. 

1.331 

9.452 

75. 

0.114 

9.953 

85. 

0.003 

9.999 

95. 

0.000 

10.000 

Average 

9.259 

There  are  several  interesting  statistical  problems  that  can 
be  tackled  rcM.  One  is  the  problem  of  optimal  strategies  of 
crossing  a field  vhen  there  is  no  complete  information  on  the 
scatter  distributions  of  the  mines  in  each  cluster  and  on  the 
number  of  mines  in  each  cluster.  If  this  information  is  available 
we  can  easily  find  the  path  for  \«hich  the  expected  number  of  sur- 
viving targets,  out  of  n crossing  in  a column,  is  maximal.  One 
can  impose  on  this  maximization  problem  also  additional  con- 
straints of  the  battlefield.  On  the  other  hand,  whei;  the  infor- 
mation needed  to  compute  the  distribution  of  the  number  of  mines 
in  each  path  is  incomplete  the  decision  prc^lem  becomes  that  of 
choosing  from  m alternative'  paths  one  having  the  most  favorable 
distribution  of  the  nutiber  of  mines  in  the  path.  The  decision  of 
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how  to  ciross  the  n targets  is  performed  in  a sequential  manner. 
According  to  sane  prior  consideration  a crossing  path  is  chosen 
for  the  first  target.  The  result  of  the  first  crossing  attcnpt 
(success  or  failure  and  the  points  along  the  path  at  which  mines 
were  destroyed)  leads  to  a reevaluation  of  the  strategy  and  a 
crossing  path  for  the  second  target  is  then  chosen,  and  so  on. 

The  objective  is  to  find  a decision  rule  for  maximizing  the 
ejqaected  number  of  survivors.  Zacks  [8]  studied  the  problem  pre- 
viously for  the  case  of  two  crossing  paths,  in  terms  of  the 
famous  TWO  ARMED  BANDIT  PRCBLEM.  It  is  an  interesting  and  quite 
difficult  problem  that  shcuJd  be  studied.  Algorithms  of  the 
Dynamic  Progranming  type  for  the  optimal  determination  of  tlie 
corssing  strategy  can  be  developed. 
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RHMARKS  ON  THE  PRESENTATIONS  Cf 
S.  ZACKS  AND  LT.  GENL.  W.  L.  CREECH 


by  J.  R.  THOMPSON 

nice  UtiiveMi^y  ! 

i 

1 

I should  first  like  to  thank  Professor  Zacks  for  his  expli- 
cation of  three  very  interesting  stochastic  problems.  I will 
coiment  briefly  about  each. 

In  the  inventory  problem,  it  would  be  interesting  to  carry 
out  robustness  studies  to  determine  the  sensitivity  of  the  crite- 
rion function  of  the  proposed  strategy  if  one  has  picked  an 
incorrect  distribution  for  the  datand  variables. 

In  the  manpower  forecasting  mcdel,  I did  not  fiHly  understand 
the  prediction  lead  time  being  used.  The  Box-Jenkins  ARIMA  models 
do  very  well  if  the  prediction  time  is  short  but  frequently  deter- 
iorate if  the  lead  time  is  long  enough  to  be  useful.  Does  the 
alternative  procedure  proposed  by  Professor  Zacks  overccrne  this 
difficulty?  A number  of  seemingly  inportant  variables  are  left 
out  of  the  model — e.g.,  the  unenployment  rate  in  the  civilian 
sector. 

The  mine  field  crossing  problem  has,  I believe,  more  applica- 
ticn  for  nonwestem  armies  than  for  our  own.  During  the  Second 
World  War,  the  Red  Army,  with  the  assistance  of  thousands  of 
Political  Ocmnissars , was  able  to  use  tactics  which  were  virtually 
unchanged  by  the  detection  of  minefields.  From  a coldblooded 
standpoint  of  efficiency,  such  a policy  is  fine.  However,  I do 
not  believe  even  Waffen  SS  cortmanders  tried  very  often  to  push 
their  men  through  minefields.  And  if  an  American  platoon  ccmmander 
called  to  a private  indicating  his  cannonical  path  through  a mine- 
field, I should  have  thought  it  very  lonlikely  the  private  would 
cheerily  re^nd,  "Airborne,  Sir;"  and  plunge  right  in.  Of  course 
I may  be  underestimating  the  motivation  and  overestimating  the 
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intelligence  of  the  American  fighting  man. 

Finally,  I should  like  to  make  a conment  about  a point  raised 
by  General  Creech  yesterday  afternoon.  The  General  was  concerned 
about  the  attenpt  of  sene  to  replace  the  decisicxi  making  f\anction 
of  experienced  field  cenmanders  by  the  use  of  cleaver  decision 
theoretic  models.  In  my  view,  this  concern  is  well  placed. 

Twenty  years  ago,  before  the  advent  of  Secretary  McNamara, 
most  military  decisions  were  mde  by  seasoned  heuresticians  vdio 
were  bli-isfully  ignorant  of  systems  analysis  but  who  knew  military 
history  very  well  and  had  natural  and  developed  human  abilities  to 
synthesize  reliable  and  fuzzy  data  streams  to  formulate  policy  in 
the  absence  of  any  exhibitable  objective  function.  The  main  pur- 
pose of  supporting  applied  mathematicians  was  to  render  as  reliable 
as  possible  the  data  streams — not  to  build  decision  theoretic 
models. 

With  McNamara,  this  policy  changed.  His  civilian  experts 
busily  built  decision  theoretic  models  which  were  supposed  to 
majorize  the  frankly  heuristic  approaches  of  the  generals.  In 
point  of  fact,  history  has  shown  that  McNamara's  models  could  have 
been  majorized  by  the  most  ordinary  of  coipany  coimanders.  Orr 
Vietnam  debacle  and  defeat  was  the  first  instance  in  history  where 
a war  was  lost  by  the  incorrect  use  of  applied  mathatatics.  The 
generals  who  protested  McNamara's  policies  early  on  (and  quickly 
became  silent)  have  been  vindicated.  McNamara  has  departed  fron 
the  DOD  to  the  World  Bank  where  his  personal  expertise  can  cost 
only  money.  All  that  is  lacking  is  the  endowment  of  20  chairs  of 
systans  analysis  in  assorted  American  universities  by  the  Democra- 
tic Republic  of  Vietnam  in  gratitude  for  inadvertent  services 
rendered. 

And  yet  in  a very  real  sense,  the  policies  of  McNamara— 
perhaps  useful  for  business  but  catastrophic  for  military  pur- 
poses—linger  on,  in  fact  are  well  entrenched  in  the  DOD.  In 
1971,  one  DCD  official  told  me  that  he  looked  forward  to  the  day 
when  every  platoon  cermander  in  Vietnam  would  have  a portable  time 
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sharing  terminal  into  which  data  and  feelings  could  be  punched  and 
out  of  vrfiich  vould  cone  action  decisions  down  to  the  level  of  the 
individual  riflanan. 

Such  attitudes  are  not  surprising  considering  that  anyone 
tends  to  believe  what  he  hears  over  and  over  again.  "What's  that. 
Colonel,  you're  missing  a data  stream?  Not  to  worry,  we'll  just 
Delphi  it  in  for  you."  "What,  General,  you  don't  have  an  objec- 
tive function?  CXu:  i^les  and  Oranges  Utility  Package  will  create 
one  for  you."  "What,  Admiral,  the  problem  cis  we  have  now  formu- 
lated it  defies  your  intuitions?  Of  course  it  does.  But  just 
give  us  a few  hundred  CPU  hours  on  our  6600  and  we'll  cone  tp  with 
the  answer." 

Perhaps  sane  day  ccrputer  software  will  surpass  the  ability 
of  a trained  himan  intellect  to  ccmbine  hard  and  fuzzy  data,  hard' 
and  fuzzy  desiderata  into  a military  decisicn.  That  day  is  not 
yet  cane.  As  yet  there  exists  no  viable  alternative  to  the  tradi- 
tional pre-McNamarian  forms  of  military  decision  making.  To 
paraphrase  Clemenoeau,  war  is  too  important  to  be  left  to  the 
systems  analysts. 
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SCME  RESULTS  CN  SUBSET  SELECTION  PRCX3EURES  EX» 
DCXJBLE  EXPCNENTIAL  POPUIATIONS 

by  SHANTI  S.  GUPTA  AND  YOCN-KWAI  LEONG 
PuAdue.  UniveM-ity 


AbitAocX..  A subset  selecticjn  procedure  based  on  the  sairple  medi- 
ans for  selecting  the  largest  of  the  location  paraneters  of  k 
double  exponential  (Laplace)  distributions  is  studied.  These 
unknown  location  parameters  also  represent  the  medians  or  means 
of  the  double  e:q»nential  populations.  An  indifference  zone 
^>proach  to  the  problem  of  selecting  the  populations  with  the  t- 
largest  unknown  location  parameters  is  discussed.  For  this  dis- 
tribution the  prcAilem  of  selection  for  the  largest  scale  parameter 
is  also  investigated.  ^ test  of  homogeneity  is  proposed  vdrich  is 
based  on  the  range  of  sample  medians.  Closed  forms  of  the  distri- 
bution of  the  statistic  associated  with  the  subset  selection  pro- 
cedure for  locatioi  parameters  are  obtained  for  some  speical  cases. 
Tables  of  the  tpper  percentage  points  of  this  statistic  are  com- 
puted. An  exanple  is  given  to  illustrate  the  use  of  the  selection 
procedure  and  the  test  of  homogeneity  for  the  location  parameters. 
1.0  ! ntnoducAxon . In  this  paper  ws  stucty  the  selection  problems 

and  some  other  related  statistical  inference  problems  for  k 
double  exponential  (Laplace)  populations.  Before  we  do  this,  we 
give  some  discussion  of  the  Laplace  distribution,  its  character- 
istics (vs.  normal,  logistic  and  Cauchy)  and  its  use  as  a model  in 
statistics  and  probability. 

The  double  exponential  distribution  arises  as  a model  in  some 
statistical  problems  as  esplained  later.  This  distribution  is 
also  considered  in  robustness  studies,  which  suggests  that  it 
provides  a model  with  different  characteristics  tbian  some  of  the 
orther  cortnonly  used  models  such  as  the  normal  distribution.  In 
particular,  the  tails  of  the  double  exponential  distribution  cure 
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thicker  than  the  tails  of  the  nontal  or  logistic,  but  not  as 
thick  as  the  Cauchy  (see  p.  43,  Hajek  [14]).  Yet  tte  double 
exponential  has  not  been  used  very  extensively  as  a model.  This 
could  be  due  in  part  to  the  lack  of  available  statistical  techni- 
ques for  this  distribution,  although  it  is  likely  that  the  ejq^er- 
imenter  has  shied  away  frctn  using  the  double  exponential  because 
it  has  a sharp  peak  in  the  center.  However,  many  afpLications 
would  be  primarily  concerned  with  tail  probabilities,  and  it  would 
seem  that  the  double  exponential  would  be  a useful  model  if  espo- 
nential  tails  are  required. 

The  double  exponential  has  seme  application  as  a model  in  the 
area  of  Actuarial  Science,  and  it  has  been  suggested  as  a model 
for  the  distributicn  of  the  strength  of  flaws  in  materials  by 
Epstein  [8].  Using  the  weakest  link  principle,  the  strength  of 
the  material  should  decrease  as  the  number  of  flaws  or  volume 
increases.  In  particular,  frem  extrane-value  theory  the  double 
exponential  assunption  leads  to  the  result  that  the  mode  or  most 
probable  strength  decreases  in  proportion  to  log  n,  where  n repre- 
sents the  size  or  nimber  of  flaws  of  the  material.  In  conparison, 
the  assunptioi  of  a normal  model  leads  to  a decrease  in  proportion 
1/2 

to  (log  n)  . For  most  applications  to  naterial  strength,  only 
the  minimum  flaw  strength  would  ordinarily  be  observable;  however, 
Epstein  [8]  suggests  that  there  may  be  many  other  types  of  prob- 
ians,  such  as  a system  of  cotponents  in  series,  vrfiich  might  be 
similar  from  a statistical  point  of  view.  Other  possible  ajpli- 
cations  of  the  double  exponential  are  suggested  by  the  fact  that 
the  difference  of  two  independent  (not  necessary  identical)  two 
parameter  exponential  variables  follows  the  double  exponential 
distributicn,  and  that  the  logarithm  of  the  ratios  of  uniform  or 
Pareto  variables  follows  the  double  exponential  distributicn. 

In  classical  theory,  once  having  assuned  the  form  of  the 
parent  distribution,  we  can  derive  a criterion  which  is  appropri- 
ate to  this  assuiption.  For  exanple,  under  the  assumption  of 
normality,  for  the  cotparison  of  two  mgans  we  would  derive  the 
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t-statistic.  It  is  then  custcmary  to  justify  the  use  of  such  a 
normal  theory  criterion  in  the  practical  circunnstance  in  vsihich 
normality  cannot  be  guaranteed  by  cunguing  that  the  distribution 
of  the  chciracteristic  is  but  little  affected  by  non-normality  of 
the  parent  distribution  - that  is,  it  is  r<±)ust  under  non-normal- 
ity. However,  this  argunent  ignores  the  fact  that  if  the  parent 
distribution  really  differed  fron  the  normal,  the  appropriate 
criterion  would  no  longer  be  the  normal-theory  statistic.  Box 
and  Tiao  [4]  reconsidered  the  analysis  of  Darwin's  paired  data 
on  the  heights  of  self  and  cross-fertilized  plants  quoted  by 
Fisher  in  "The  Design  of  Experiments  (1935)".  In  this  develop- 
ment the  parent  distribution  is  not  assuned  to  be  normal,  but 
only  a member  of  the  follcwing  class  of  syimetric  distrihuticns 


p(yle,o,B)  =- 


r[l  + ^(l+B)]2 


1+^{1+B) 


, ^ . 2/ (1+3) 
-exp{-ili^|  - ) 


vAiere  - »><y<oo,  0<o<“>,  - '“<0<»>,  -1<6<1.  This 
class  of  distributions  includes  the  normal  (6=0)  and  the  double 
e:qx)nential  (6=1),  and  its  )curtosis  parameter  is  6. 

If  the  prctoability  density  function  of  tie  double  exponential 
is  given  by 


f (x,6,o)  = ^ e 


,-oo<x<“,  - “<0<<»,  o>0 


then  the  node  of  the  distributicm  is  x = 0 where  it  has  a sharp 
peak.  The  expected  value  and  stcindard  deviation  of  (1.2)  are  0 
and  a respectively.  Mnnents  of  the  standardized  double  ex- 
ponential order  statistics  can  be  obtained  by  using  the  closed- 
form  ejqjressions  for  the  nonents  of  the  standardized  negative  ex- 
ponential order  statistics  derived  by  Epstein  and  Sobel  [9]. 
Govindarajulu  [10]  has  given  the  expressions  for  these  moments. 

Chew  [6]  gives  the  graphs  of  the  standardized  density  funct- 
ions of  normal,  logistic  and  double  exponential  distributions. 
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from  vAiich  it  is  clecir  that  the  tails  of  the  double  exponential 
distribution  are  thicJcer  than  that  of  the  nomal  or  logistic,  in 
the  sense  that  the  curve  of  double  exponential  is  above  that  of 
the  others  to  the  left  and  right  of  sane  points.  In  the  case  of 
the  nomal  distribution  this  point  is  2.64. 

If  the  cvitulative  distribution  functions  G^{x)  = 


2 


u 


du  and  G2(x)  = 


1 


^ e , X < 0 

1 _ 1 X > 0 


of  the 


standardized  normal  and  double  exponential  distributions  are 
conpared,  (also  similar  ccnparison  between  standardized  logistic 


GjCx)  = 1/(1  + e 


and  the  double  e:qxjnential  distribution) 


the  differences  G2  (x)  - Gj^  (x)  (as  well  as  G2  (x)  - G3  (x) ) Vcuy 
in  the  way  shewn  in  the  graph  below.  Since  G^^  (x) , G2  (x)  and 

G3(x)  cure  synmetric  about  x = 0 only  the  values  for  x ^ 0 are 

shown. 

With  regard  to  point  estimation,  it  is  well  known  that  the 
maximiin  likelihood  estinBtes  based  on  the  ootplete  sanple  of  size 
. - . , n 

n are  given  by  0 = X and  a = — I jx.  - x| , where  X denotes 

i=l  ^ 

the  sanple  median.  Also  best  linear  estimators  (bcised  on  order 
statistics)  under  synmetric  censoring  cure  given  by  Govindarajulu 
[11]  for  sanple  sizes  up  to  20,  and  sane  alternate  estimates  are 
suggested  by  Raghunandanan  and  Srinivasan  [16].  Interval  estima- 
tion for  the  parameters  of  the  two-paarameter  double  exponential 
distribution  is  considered  by  Bain  and  Engelhardt  [1]. 

Now  we  discuss  the  problem  of  corparison  of  k(^  2)  double 
expxxiential  distributions.  First  we  study  the  selection  problem 
for  the  largest  mecin  (location) . 
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2.0  SeZzcX^ng  A SubieX  ContcUyUng  the  Be^t  oj  Se.veAal  Voubte 
Expomntatt  Populationd  WXXh  RtipzcX  to  the  Location  Pa/LCumiXe/i 
(A)  Fortnulation  of  the  Prctolan 

Let  i = be  k ind^aendent  randctn  variables 

from  double  exponential  population  ti.,  i = l,2,...,k  respective- 
ly, with  probability  density  function 

f(X;6^,o)  = ^ exp  [-jx-e^l/o],  - o>0 

viiere  o is  a camon,  kncwn  constant  for  each  of  the  k popula- 
tions. We  may,  without  loss  of  generality,  assime  o to  be  one. 
The  ranked  parameters  are  denoted  1^  < 0^2]  1 1 

As  before,  it  is  assuned  that  there  is  no  a priori  inforTiation 
available  about  the  correct  pairing  of  tte  ordered  and  the 

k given  peculations  frem  viiich  observations  are  taken.  Any  pop- 
ulation vAose  parameter  value  equals  will  be  defined  as  a 

best  population.  A correct  selection  (CS)  is  defined  as  the 
selection  of  any  sxjbset  of  the  k given  populaticais  which  con- 
tains at  least  one  best  population. 

Suppose  VE  take  (2n  + 1)  independent  observations  fron  71^, 

i = 1,2,  — ,k;  the  saitple  size  (2n  + 1)  is  assuned  to  be  given 
in  the  primary  prciilem  below.  Let  P*  (^  < P*  < 1)  be  a pre- 
assigned constant.  Let  P(CS;  k,  n,  £,  R)  denote  tl»  probability 
of  a correct  selection  vAven  the  procedure  R is  used  with  the 
given  k,  n and  when  the  true  configuration  of  parameter  values 
is  £ = (0^,  02,...,0j^);  let  the  space  of  all  possible  values 

of  £ be  denoted  by  n. 

The  problem  of  primary  interest  is  to  define  a procedure  R 
vrfiich  selects  a subset  of  the  k given  populations  that  is  small, 
never  erpty,  and  large  enough  so  that  it  certains  the  best  popu- 
laticm  with  probability  at  least  p*,  regardless  of  the  true  con- 
figurations ^ in  n,  i.e.,  so  that 


yie^  (2.3) 


Now,  we  propose  the  selection  procedure  as  follows: 

Retain  in  the  selected  subset  cxily  those  populations 

for  which 

Y.  > max  Y . - d (2.4) 

l;fj<k  J 

where  d = d(lc,  n,  P*)  is  the  smallest  non-negative  constant  to 
be  determined  that  wri.ll  satisfy  the  basic  probability  requirement 
(2.1)  for  all  configurations  £=  (e^,  d^,  ...,  e^^) . 


inf  P(CS;  Ic,  n,  R)  ^ P*  . (2.1) 

n 

After  having  defined  a particular  procedure  R = R(k,  n,  P*)  for 
each  possible  set  of  values  of  Jc,  n and  P*,  we  discuss  the 
esqected  size  E{S;  k,  n,  P*,  R)  of  the  selected  subset  when 
the  procedure  R is  used  with  the  given  k,  n,  P*  and  where  £ 
is  the  true  parameter  configuration  in  n. 

l£t  Y^  denote  the  sanple  median  of  the  (2n+l)  chservaticns 

fron  the  ith  population,  and  let  Y^j  denote 
that  unknown  variable  which  is  associated  with  9 ^ j • The  prob- 
ability density  end  the  cimulative  distributiai  G^(‘)  of 

Y^  are  given  by 

, „ , (2n+l)'  ,1  ■Iy"®il  1 -|y-eil  n 

^n'^'  V ) (2.2) 

, 1 ? ,2n+l.,l  1 y-0i  2n+l-j 

j=0  ^ ^ 2 1 


G„(y;ei)  = 


(B)  Probability  of  a Correct  Selecticn  and  Its  Infiimw 

The  following  result  oonceming  the  rule  Rj^  can  be  proved. 

ThtoAm  2.K  inf  P (CSlR.)  = inf  P (CS|R,)  = / G'^"^(y-Ki)g  (y)dy 

dc»  - ^ deSi  - ^ ^ 

“ — o 

vtere  = {0  = (6^,  6j^);  = 02  = • = \ = ej.  G^(y)/ 

gj,(y)  are  the  cdf  and  pdf  of  the  sanple  median  of  (2n+l)  obser- 
vations from  the  standard  double  exponential  distribution. 

PAOpj.  For  £ £ n, 

P^(CSlR^)  =P^{Y{^j  _d} 

" V^(k)“®[k]-^(j)”®[j]'^®[j]"®[k]‘‘^'  j=l»2,...,k-l} 

“rk-1  -0  . -fd  1 

= / n f g (z)  dz  g (y)  dy.  (2.5) 

-« L j=i  -a.  " J 

Note  that  0jj^j  - 0jjj  ^0  for  j = 1,  ...,  k-1;  thus  the  result 

follows.  Hence,  if  we  choose  d to  be  the  atallest  constant  to 
satisfy 

/ (y-Ki)  gj^(y)  dy  = P*,  (2.6) 

then  we  have  determined  the  constant  d for  vhich 

inf  P (CS|r.)  = P*.  (2.7) 

- 

(C)  Some  properties  of  Rj^ 

For  ^£$1  and  £=  define  PgCi)  = Pg 

(R  select  populaticu  ”(1)^'  receill  the  following  definitions 
(see  Santner  [17]). 

Vzii.inition  2,1 . The  rule  R is  strongly  monotone  in  n means 
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n > <»  for  fixed  A. 

(D)  Asymptotic  Results  for  the  Procedure 

It  suffices  to  consider  the  parameter  space  For  n 

large,  v<e  discuss  an  asynptotic  property  of  the  procedure  as 
follows.  Let  Y be  the  sample  median  fron  a sanple  of  size 

(2n+l)  with  pdf  f(x;0)  = J e - <»  < x < <».  Then  it  is 

Y_0 

kncwn  (see  Chu  [7])  that  under  , is  asymptotically  normally 

n 

2 1 

distributed  (here  ^ ‘ ^ denote  a randan  variable 

Y— 6 

vhich  has  a standard  normal  distributioi  then  - — is  asynptoti- 

°n 

cally  distributed  as  Z.  Hence,  under  Ci^,  the  prciability  of 
Y > max  Y.  - d 

W ^ 
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is  asynptotically,  the  same  as  the  probability  of 


Z.  ^ max  Z.  - /2M  d (2.13) 

l^^k  ^ 

vAiere  Z^,  i = l,2, ,)c,  are  iid  standard  normal  variables. 

Hence, 

inf  P (CS|lt)  ^ P{Z,  > max  Z.  - d} 

eeJlo  ^ ^ l^<k  3 

“ k-1 

= / $(z  + /2n+l  d)  d$(z) 

where  $(•)  is  the  cdf  of  the  standard  normal  distribution. 

(E)  The  Monotone  Likelihood  Ratio  Property  of  the  Sanple  Median 
Sv:ppose  Y is  the  sairple  median  of  (2n+l)  ctoservations  fron 
the  populatiai  with  double  exponential  density  functicn  f(x;0)  = 
_ I X— 0 I 

^e  ' The  pdf  g|^(y;e)  and  cdf  G^(y;e)  of  Y are  given 

by  equations  (2.2)  and  (2.3). 

After  sane  algebraic  coiputations,  we  see  that  G^(e;0)  = j; 
also  it  is  easy  to  shew  that  gj^(y;6)  is  continuous  at  y=0. 

gj^Cyye)  = gj^(y-6).  it  is  shewn  in  Lehmann  [15,  p.  330] 
that  a necessary  and  sufficient  condition  for  g^(y-6)  to  have 
monotone  likelihood  ratio  in  y is  that  -log  g^  is  convex.  Our 
main  goal  in  this  section  is  to  prove  this  assertion.  Now 

gn(y)  = e“l^h”''’^(l  - i vhere  c^  = ' , so, 

- log  gj^(y)  = - log  c^^  + (n+1)  log  2 + (n+1)  |y|  -n  log  (1  - i e~l^ 

Let  h(y)  = (n+l)|y|  - n log  (1  - ie"l^l)  = (hj^(y),  y < 0 which  is 

1^2  (y) , y ^ 0 
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value  of  the  size  of  the  subset.  New  we  derive  an  expressicai  for 
E(s|Rj^),  the  expected  size  of  the  selected  subset  using  procedure 


E(S|R, ) = y P{ Selecting  the  population  with  parameter  9,.,] 
•L  UJ 


= I > max  Y - d) 

i=l  ^ ’ l<j<k  'J' 


iM-ll 


(y)  (fy.  (2.16) 


If  we  set  the  m siallest  parameters  (1  £ m < k)  equal  to  a 
oemon  value  9 (say)  and  define 

Q = E(S  I = ...  = 9jj^j  = 9)  (2.17) 

then  by  an  analogous  argument  as  in  Gupta  [13]  one  can  prove  the 
following  theorem. 

TheoAm  2.4.  For  given  k,  P*  (i  < P*  < 1) , the  ejg)ected  size  of 
the  selected  subset  E(S  | = 9^2]  ~ m < k)  in 

using  the  procedure  R^^  is  strictly  increasing  in  9. 


CofLotiani, 


2.2.  sup  Eg(S|R^)  = k / G^"^(y-Ki)gj^(y)  dy  = k P*. 


Co^LoULaMj  2.3.  In  the  subset  fi(6)  = {^:  9^^  £ 9jj^j  - 6, 

i = 1,2, . . . ,k-l},  the  function  Eg(S|Rj^)  takes  on  its  maximun 
value  vten  9^j  = 9jj^j  - 6,  i = l,2,...,k-l,  euid  so 

stp  Eg(S|Rj^)  = / (^"^(y+d+6)  g (y)  dy 

Ben(S)  — 


" i=l  ^ 


= k Pg  (CSlR'). 

— o 


lA  ’"'''3’ 


dYi 
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(2.22) 


r 


Hence  for  6 e a , 

— o o ' 

Eg  (SlR')  - Eg  (SlR^)  = k [P  (CSlR')  - P (CS|R  )] 

— o — o — o — o 

If  the  rule  R'  satisfies  the  basic  P*  condition,  it  follows 
fran  (2.20)  that  the  right  hand  side  of  (2.22)  is  non-negative. 
Thus 

Eg  (S|R')  > E (S|R  ) = sup  E (S|R^). 

— o — o — 

So  that  sup  E (S|R')  ^ sup  E (S|r.  ) 

i.e  the  rule  R^  is  miniitax  among  all  invariant  rules  satisfying 
the  P*-condition. 

3.0  Selecting  th^  Population  viith  thz  LoAgut  Loccution  ?cuiameteA- 
lrtdi^ieA&nce.  Zone  AppAoach.  in  this  section,  we  would  like  to 
use  the  indifference  zone  aj^roach  of  Bechhofer  [3]  to  select  one 
population  which  is  guaranteed  to  be  associated  with  the  largest 
location  parameter  with  a fixed  probability  P*  whenever  the  un- 
known parameters  lie  outside  seme  subset,  or  zone  of  indifference, 
of  the  entire  parameter  space.  The  goal  is  to  define  a sequence 
of  rules  {R2(n)}  each  of  which  selects  a single  population  n 

and  find  the  anal lest  n so  that 

Pg(CS|R2(n))  > P*,  een(S*)  = {£:  >6*}  (3.1) 

where  P*  and  6*  are  preassigned  numbers. 

For  the  sake  of  clarity,  we  will  use  the  notation  Y,,  , to 

(kjn 

denote  the  largest  of  the  sanple  medians  each  based  on  (2n  + 1) 
observations.  R2(n):  Select  the  population  corresponding  to 

'^[kln’ 
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- «*}.  Hien  we 


i£t  {0:6^j  - ...  - - ej^j 


have  the  following  theoran, 
inf 

£en(6*) 

Piooj|[.  For  £ E n(6*) , 


Theorem  3.  1 . inf  P (CSlR_(n))  = inf  P (CS|R,(n)) 
0Enf6*^  ^ ^ 6enQ(6*)  - 


Pg(CSiR2(n))  = ^(j)n  < ’'(Wn^ 


V^(j)n  ^ '^(k)n'  ^ ~ 1-2, ...,k  1} 


V’^(j)n“®(j]  ^ ''^(k)n  ®[k]‘^®[k]”®[j]'  i-l'2,...,k-l) 


= / 


k-l 

n G(y  + 6.,) 


b=i 


■n'^  ■ “kj' 


d Gj^(y) 


(3.2) 


vrtiere  G^(y)  = G^(y;  0)  is  the  cdf  of  the  sanple  inedian  of 
(2n+l)  independent  observation  from  the  standard  double  exponen- 

1 -1x1 

tied  distribution  with  density  function  ^e  ' -<»  < x < <», 

and  ^0.  Hence  the  infimum  of  the  probability 

of  a correct  selection  o<3curs  when  0r,i  = 6,_,  = ...  = 6,,  , 

11]  [2]  [k-l] 

0JJ.J  - 6*  provided  ejj.j  - 0jj,_2j>.  6*.  This  proves  the  theorem. 

The  miniimm  sanple  size  required  to  achieve  the  P*  condi- 
tion (3.1)  is  the  anallest  integer  n such  that 

/ [G^(y  + 6*)]’'“^  d G^(y)  > P*.  (3.3) 

—00 

4,0  SeZe.c-tinci  -the.  Popu£aXxoni  - In(fi|(i(eA.ence  Zone.  AppKoach. 

New,  we  consider  the  problem  of  seleoAing  the  best  t pc^pulaticns , 
i.e.,  the  populations  with  location  parameters  '®[k-t+2] ' 

•••»0[k]»  without  regard  to  order.  We  are  using  the  indifference 
zone  approach  based  on  the  sairpe  median  of  2n+l  independent 
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observations  fron  populaticai  i = Define  a sequence 

of  procedures  as  follows:  R^Cn):  Select  the  t populations 
cissociated  with  t largest  values  of 

Let  !2'(6*)  = {6:  0[k_t+i]  " ®[k-t]  - ^ 

= {6:  0[i]=---=e[k-t]"®'  ®[k-t+l]"‘"'^®[kl  " 

ThzofLm  4.1.  inf  P„{CSlR,(n)}  = inf  P.{CS|R,(n)} 
£En'(6*)  - ^£0^(6*)  i 

P'100 j.  It  was  shewn  in  Theorem  2.3  that  the  pdf  g^^Cy;  0)  of  the 

sairple  median  has  monotone  likelihood  ration  in  y,  which  inplies 
that  it  is  stochasticcilly  increasing  in  6.  Using  a theorem  of 
Barr  and  Rizvi  [2],  it  follows  that,  for  si' {&*) 

P„{CS|R,(n) } = P { max  Y,.,  < min 
- ^l<i<k-t  k-t+l£j<k 


is  a non- increasing  function  of  ® » • • • ' ® ^ non- 
decreasing function  of  6 ,...,6  . Thus  PgiCSlR^Cn)) 


attains  its  infiimin  vdien 
possible  values,  vdiile  0 


attain  their  maxiirun 
, . . . ,0  attain  their  mininuan 


possible  values  subject  to  £e  n'(6*).  The  proof  is  thus  com- 
pleted. 

Using  the  same  notation  as  in  section  2,  let  G^(y<‘®j^) 
denote  the  odf  of  the  sanple  median  Y^  with  parameter  0^. 

Since  0^  is  the  location  parameter,  G^^Cy;  ®i)  = ~ ®i' 

and  is  stochastically  increasing,  continuous  in  both  y and 
0^.  For  £en'(6*). 
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P„{CSlR,(n)}  = P„{  nax  Y...  < Y.  ) 


- j=k-t+l  'J'  k-t+lj<££k  ’ 


and 


l<i<k-t 


k » k-t 

n 

j=k-t+l  -<»  6=1 


! A «n<y'®[6]^  " 


a=k-t+l 
cii^j 


In  particular,  for  £ e n^(i*)  eft' (6*), 

PJCSlR  (n)}  = t / C^'^Cy.-O)  {1  - G„(y;0+6*)}^"^  dG„(y,0+6*) 

D * ^ 00  ^ ^ 

= t / (^"’^(y-0;O){l-<3j^(y-e-6*;O)}*^”^dGj^(y-e-6*;O) 


= t / (^■^(y+6*;0)  {1  - G^(y;0)}*'"^  dGj^(y;0) 

“OO 

wtuch  is  independent  of  the  parameter  0.  Hence  for  specified 
values  of  6*  and  P*  ( < P*  < 1) , we  can  solve  the  equation 


t / gJ^‘^  (y  + «*:  0)  {1  - G^(y;  0))^"^  dGj^(y;  0)  = P* 


for  n. 

5.0  SubieX  Se^zcUon  uxUh  Respect  to  the  Scale  Pa/uuneXgA  Let 
X^,  i = l,2,...,k  be  k independent  randan  variables  from  double 

exponential  populations  n^,  i = l,2,...,k,  respectively,  with  ir^ 

having  the  probability  density  functicxi 

f(x;0^,o^)  = exp  [-|x-0^1/o^l,  -»<  x <»,-»<  0^  <»,  > 0. 
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Take  n independent  observations  fron  ti^,  i = 

From  these  data  one  wishes  to  select  a subset  containing  the  popu- 
lation with  the  largest  Let  1 • • • be  the 

ordered  parameters.  We  consider  two  different  cases. 

Case  (i) : 0^^,  e2f  • • • / 9)^  known. 

In  this  case,  the  maximum  likelihood  estimator  of  is 
1 " 

Yi  = i I '*ich  is  distributed  as  a gaimia  variable 


with  parameters  n and  , i.e.  has  density 

_ rsL 

n-1  o . 

— (^)  e ^ < y > 0.  Thus  the  probloti  reduces  to  the 
a^l  in}  ^ 

one  considered  by  Gupta  [ 12 ] . The  selection  procedure  is 
R:  Select  the  population  in  the  subset  if  and  only  if 

Y.  ^ c max  Y.. 

^ l£j_<k  ^ 

Case  (ii) ; 9^'s  are  unknown. 

When  0 . is  unknown,  it  is  well  known  that  the  maximum 
1 

1 " 

likelihood  estimate  of  is  given  by  . I 1 j " I ' 

\4>ere  denotes  the  sanple  median  from  population  ir^.  For 

this  problan,  we  propose  the  following  selecticxi  procedure. 

R^:  Select  the  population  in  the  subset  if  and  only  if 

a.  > c.  max  o . 

where  0 < c^  < 1 is  so  determined  as  to  satisfy  the  basic 
probability  requirement  regardless  of  vhat  the  unknown  o^^'s 
my  be. 


Let 


“>  k-1  x-/n(c.-l) 

= / 'l’  ( ) d4>  (x) . 


6.0  A Te^-f  of,  Homoqemittf  Boied  on  the  Sample  Median  Range..  Let 
be  k independent  double  exponential  populations 

such  that  the  observations  X. X.  _ . frcm  n.  has  density 

XX  X f fcn' X X 

1 -Ix-eJ 

2 e , for  i = 1,2, As  before,  let  the  sanple  median 

of  these  (2n+l)  ctoservations  be  denoted  as  Y^,  i = l,...,k.  In 
some  practical  situatiwis  one  wishes  to  know  whether  0^  are 

significantly  different  or  not.  This  problem  is  to  test  the 
hcmogeneity  of  the  double  exponential  peculations.  We  are  inte- 
rested in  using  a test  based  on  the  sanple  range  of  Y's  and  hence 
we  wish  to  derive  the  distribution  of  the  sanple  median  range 

R = max  Y.  - min  Y.,  considering  all  0.  to  be  equal  to  a 
l^j^k  ^ ^ 

cannon  unknown  0.  When  the  value  of  R is  large,  the  hypothesis 
of  hcmogeneity  is  rejected.  We  wish  to  find  a constant  r,  such 
that  P(R  > r)  £ a under  the  hypothesis  H^:  0^  = . . . = 0j^  = 0 . 

This  will  provide  an  a -level  test. 

Thzofim  6.1 . For  a,  O < a < 1,  let  r be  a constant  such  that 
P {Y  > max  Y - r}  > 1 - ^ . 

Then  P^  (R  > r)  ^ a. 
o 

Piooij.  When  is  true,  i.e. , under  f!^, 

P(R  > r)  = P(  max  Y-  - min  Y-  > r} 
l_<j<k  ^ l<j<k  J 


k 

_<  k - I P{Y.  ^ max  Y.  - r} 
i=l  l<i<k  ^ 


k - k P{Yj^  > 


l£j^k 


max 


l^<k-l  ^ 


r} 
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< k - k-  (1  - ^ ) 

= a. 

The  above  theorem  establishes  a oonnectitai  between  the 
selecticxi  rule  and  the  above  best  for  equality  of  a's. 

7.0  On  thz  V-iitA^bution  the.  Statuette  Kb&oeiated  Mith  Rj. 

Let  = 0,1, ...  ,p)  be  (pbl)  independent  and  identically 

distributed  random  variables  each  representing  the  median  in  a 

random  sanple  of  size  (2n+l)  frcm  a population  with  standard 

1 - Ixl 

double  exponential  density  function  f (x)  = j e • Consider 
the  differences  - ^o^^  “ l,2,...,p).  The  randan  vari- 

ables Z^(i  = 1,2, ...,p)  are  correlated  and  the  distribution  of 
the  maxirrum  of  is  of  interest  in  problems  of  selecting  and 

ranking  for  double  exponential  distribution  as  explained  earlier 
when  discussing  In  this  section,  we  give  a closed  form  of 

the  distributiai  of  Z = max  Z.  for  sane  special  cases.  We 

l_<i3)  ^ 

have  also  computed  tables  of  the  upper  percentage  points  of 

Z = max  Z.  corresponding  to  the  probability  levels  a = P*  = 

l±i^  ^ 

0.75,  0.90,  0.95,  0.99  for  p = 1(1)  9,  n = 1(1)10. 


For  the  special  case  P = 1 (k=2) , n = 1 (sanple  size  = 3) , 
straight  forward  integration  gives  the  cdf  of  Z (see  formulae 
(2.2),  (2.3))  as 


-4z  ^ -5z 

■ 896  ® " 256  ® 

All  conputations  related  to  and  given  at  the  end  of  this 
chapter  were  made  cxi  a CDC  6500  using  Gauss  Laguerre  quadratue 
based  on  fifteen  nodes  to  perform  the  nunerical  integration. 
Checks  on  the  accuracy  of  the  program  for  p = 1,  n = 1 showed 
that  these  values  seem  to  be  correct  to  three  decimal  places. 

S.O  Am  Example  and  Application  oj  the  Selection  Rule  and  the 
Te.it  ofi  Homoqenetfi/.  Vfe  would  like  to  illustrate  the  use  of  the 
selection  procedure  and  the  test  of  hcmogeneity  of  location  para- 
meters for  double  exponential  distributicns . It  is  known  that 
the  difference  of  two  independent  two-parameter  exponential  vari- 
ables with  the  same  scale  parameter  follows  a double  exponential 
distribution.  Using  a statistical  package  G6-RVP  designed  by 
H.  Rubin  and  C.  Hinkle  at  Purdue  University,  vie  generated  a set 
of  exponential  random  numbers,  from  which  we  obtained  5 sets  of 
double  exponential  randan  numbers  wri.th  location  parameters 


to  be  0,  2.5, 

. 3.4,  -2.0,  • 

-0.65.  Let 

denote  the 

double 

exponential  population  with  location  parameter  e . 

and  scale 

parameter  1. 

The  five  pseudo-randan  saitples  fron  n 

i' 

i = 1,...,5, 

are  given  as 

follows.  In  each  case  9 observations 

were  taken. 

^1 

”2 

”3 

’'4 

-3.4839 

- .9839 

- .0839 

-5.4839 

-4.1339 

-2.6762 

- .1762 

.7238 

-4.6762 

-3.3262 

- .3129 

2.1871 

3.0871 

-2.3129 

- .9629 

- .2264 

2.2736 

3.1736 

-2.2264 

- .8764 

- .1761 

2.3239 

3.2239 

-2.1761 

- .8261 

.1461 

2.6462 

3.5462 

-1.8538 

- .5038 

.3033 

2.8033 

3.7033 

-1.6967 

- .3467 

1.6160 

4,1160 

5.0160 

- .3840 

.9660 

5.6924 

8.1924 

9.0924 

3.6924 

5.0424 

Let  = 

■ sanple  median  of  saitples  of 

size  9.  Then  Y^^  = 

-.1761,  Y2  = 

2.3239,  Yj  = 

3.2239,  Y4  = -2. 

.1761,  Y5  = 

-.8261.  The 

procedure  proposed  for  selecting  a subset 

to  include 

the  popula- 
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tion  with  largest  location  parameter  (or  median)  6 is 
R, : Select  population  n.  iff  Y.  ^ max  Y.  - d. 

For  P*  = 0.95,  the  tabulated  value  of  the  selection  constant  d 
corresponding  to  k = 5 (p  = 4)  and  n = 4 is  1.3210,  hence  R^ 

reduces  to 

Rj^:  Select  population  iff  Y^  ^ 3.2239  - 1.3210  = 1.9029 
vihich  selects  populations  ^2  and  113  corresponding  to  the  two 

largest  values  of  sanple  medians. 

For  the  problem  of  testing  the  hypothesis  H:  = $2=  ...  = 

05,  let  a = 0.05,  so  that  1-^=1-  = 0.99;  again,  we 

find  from  the  table  at  the  end  of  the  paper  that  the  critical 
value  r is  1.7942.  Since  the  sanple  median  range 

R = max  Y . - min  Y.  = 3.2239  - (-2.1761)  = 5.4 
lcj£5  d l£jj<5  d 

which  is  greater  than  the  critical  value,  the  hypothesis  H:  0^  = 
...  = 0^  is  rejected  at  5%  level  of  significance. 

REFERENCES 

[1]  Bain,  L.  J.,  and  Engelhardt,  M. , Interval  estimation  for  the 
two-parameter  double  exponential  distributicn.  Technonetrics , 
15,  (1973),  pp.  875-887. 

[2]  Barr,  D.  R. , and  Rizvi,  M.  H.,  An  introducticn  to  ranking  and 
selection  procedures.  J.  Amer.  Statist.  Assoc.,  61  (1966) 
pp.  640-646. 

[3]  Bechhofer,  R.  E. , A single-sanple  multiple  decision  procedure 
for  ran)cing  means  of  normal  populations  with  known  variances. 
Ann.  Math.  Statist. , 25,  (1954),  fp.  16-39. 

[4]  Box,  G.  E.  P. , and  Tiao,  G.  C. , A further  look  at  rc±>ustness 
via  Bayes's  Theorem.  Biotnetrika,  49,  (1962),  pp.  419-432. 


162 


[5]  Chemoff,  H. , Gastwirth,  J.  L. , and  Johns,  M.  V.,  Asynptotic 
distribution  of  linear  conbinations  of  functicsis  of  order 


statistic  with  applications  to  estimation.  Ann.  Math.  Sta- 
tist. , 38,  (1967)  pp.  52-72. 

[6]  Chew,  V.,  Sane  useful  alternatives  to  the  normal  distribution. 

American  Statistician,  22,  No.  3 (1968)  pp.  22-24. 

[7]  Chu,  J.  T.,  On  the  distribution  of  the  sanple  median.  Ann. 
Math.  Statist.,  26,  (1955)  pp.  112-116. 

[8]  f^stein,  B. , Statistical  aspects  of  frcicture  problans.  J. 
Applied  Physics,  19,  (1948)  pp.  140-147. 

[9]  Epstein,  B.,  and  Sobel,  M.,  Life  testing.  J.  Amer.  Statist. 
Assoc. , 48,  (1953)  pp.  486-502. 

[10]  Govindarajulu,  Z.,  Relationships  among  moments  of  order  sta- 
tistics in  saitples  fron  two  related  populations.  Technone- 
trics,  5,  (1963)  pp.  514-518. 

[11]  Govindarajulu,  Z.,  Best  linear  estimates  under  synmetric 
censoring  of  the  parameters  of  a double  exponential  popula- 
tion. J.  Amer.  Statist.  Assoc.,  61,  (1966)  pp.  248-258. 

[12]  Gupta,  S.  S.,  On  a selection  and  rarJcing  procedure  for  gamra 
populations.  Ann.  Inst.  Statist.  Math. , 14,  (1963)  pp.  199- 
216. 

[13]  Ckspta,  S.  S.,  On  sane  multiple  decision  (selection  and  ranJc- 
ing)  rules.  Tecmione tries,  (1965)  pp.  225-245. 

[14]  Haje)t,  J.,  Nor5)arametric  Statistics.  Holden-Day,  San  Fran- 
cisco (1969) . 

[15]  Leltnann,  E.  L. , Testirg  Statistical  Hypotheses.  John  Wiley, 
New  yor)c,  (1959) . 

[16]  Raghunandanan,  K. , and  Srinivasan,  R. , Sirtplifieid  estimation 
of  parameter:,  in  a double  exponential  distribution.  Techno- 
metrics, 13,  (1971),  pp.  689-691. 

[17]  Santner,  T.  J.,  A restricted  subset  selection  approach  to 
ranking  and  selection  pr(±)l6iTis.  Ann.  Statist. , 3,  (1973), 
pp.  334-349. 


163 


J 


[18]  Tiao,  G.  C.,  and  Lund,  D.  R. , itie  use  of  OLUM.'  estimatxjrs 
in  inference  robustness  studies  of  the  locatioi  parameter 
of  a class  of  synmetric  distributions.  J.  Amer.  Statist. 
Assoc.,  65,  (1970)  pp.  370-386. 


tfi 


CTl 

00 

rH 

in 

CO 

00 

o 

rH 

CM 

in 

00 

p^ 

in 

o 

VD 

<N 

C^ 

CM 

<T> 

a\ 

CM 

00 

CM 

p^ 

00 

00  ro 

ro 

•— ( 

(N 

ro 

ID 

OV 

in  00 

rH 

VD 

r* 

o 

CM 

00 

00  CM 

C 

0) 

in 

00 

rH 

m 

00 

CM 

m 

p^ 

ov 

CM 

in 

P^  (TN 

CM 

•H 

5 

1 

rH 

rH 

in 

1 

Q> 

VM 

1 

•H 

0 

1 

r-t  ro 

in 

r** 

r*“ 

<TS 

VD 

m 

<7\ 

VD 

in 

VD 

^ CM 

CO 

iJ 

!y 

I 

r-* 

in 

Ov  ro 

o 

r** 

o 

p^ 

<“> 

CM 

00 

^ P^ 

CO 

C 

V 

o> 

m r- 

r-^ 

in 

00 

OV  Tf 

r' 

o 

VD 

ON 

(O  P^ 

o 

q) 

0 

m r- 

o^ 

CM 

m 

r** 

OV 

CM 

VD 

00 

OV 

CM 

VD 

00  ON 

ro 

C 

' 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• t 

• 

(1) 

(D 

0 

‘i 

\\ 

rH 

rH 

rH 

rH 

5 

•H 

in 

s 

f 

in  ro 

r«* 

CM 

ov  r** 

00 

VD 

VD 

00 

CO 

VD 

CO  P^ 

CO 

•rl 

1 

CM 

in 

00 

ro 

<y^ 

CM 

U) 

(TV 

o 

PM 

in 

00 

CO  o 

CM 

p 

H 

}'. 

CD 

r>j 

r*- 

CM 

o 

rr 

ro 

p- 

CM 

VD 

in 

00  ^ 

00 

6 

D 

tn 

00 

OV 

VD 

CO 

o 

CO 

VD 

(D 

O 

CO 

VD 

00  o 

ro 

4J 

4J 

si. 

in 

•H 

{ 

rH 

rH 

rH 

n 

c 

o 

rH 

;i 

ro 

o^ 

ro 

00 

00 

CM 

VD 

ro 

O ^ 

CO 

ON 

00  00 

in 

ON 

in 

O 

CO 

CM 

CO 

VD 

CO 

VD 

in 

00 

VD 

CO 

ON 

4-> 

1 

r- 

ro 

00 

ir> 

o 

VD 

ro 

00 

ro 

cr> 

m 

O 

in  rH 

p*- 

c 

,1 

ID 

00 

o 

VD 

o\  o 

VD 

ov 

o 

P** 

ON  rH 

rH 

rH 

' 

* 

* 

"S 

cu 

a 

1 

m 

m ro 

r** 

VD 

in  r** 

o 

in 

CM 

VD 

o 

fO  VD 

CM 

(U 

00 

fH 

O 

00 

O 00 

00 

rj- 

m 

ro 

p- 

P^  'T 

CM 

V 

OJ 

VD 

00 

ID 

'«S‘ 

CM 

rH 

0\  VD 

ov 

p^ 

VD 

ro  rH 

ON 

X 

rH 

ID 

0>  fi 

i/) 

n* 

a\  i-H 

in 

O rH 

m 

P** 

O CM 

in 

Q 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

« • 

• 

m 

c 

H 

iH 

rH 

rH 

rH 

rH 

rH 

ON 

o 

Q 

• 

'0 

TD 

V 

o 

m r*' 

C\ 

in 

o 

in 

ro 

(T» 

<Tv 

CM 

VD 

^ o 

m 

T1 

V 

CM 

o 

CM 

ov 

ro 

OV 

ov 

VD 

O 

TJ- 

^ rH 

ro 

ri 

+ 

3 

in 

in 

m 

in 

r*- 

OV  OV  00 

o 

rH 

ro 

in 

X 

fQ 

O CM 

VD 

r* 

O CM 

p** 

00 

rH 

ro 

p^ 

CO 

rH  CO 

p' 

0 

rH 

rH 

rH 

rH 

rH 

rH 

rH 

rH 

rH 

rH  rH 

rH 

1/1 

ID 

00 

ro 

in 

00 

o\ 

00 

O 

r- 

a\ 

ro 

VO 

in 

O ON 

in 

o 

ON 

8 5 

1 

CO 

CM  00 

in 

p«* 

o\  ^ 

o 

VD 

ON 

O ro 

• 

iH 

00 

00 

CM 

in 

CM 

CM 

VD 

00 

in 

On  rH 

00 

00 

•H 

’a* 

00 

00  CM 

OV 

OV 

(N 

ON 

ON 

CM  in 

ON 

R 

s: 

0 

rH 

rH 

rH 

rH 

rH 

rH 

rH 

rH 

rH 

rH  rH 

rH 

8* 

o 

U 

4J 

€ 

o 

O ^ 

rH 

rH 

rH 

a^ 

VD 

OV 

rH 

in 

o 

^ in 

P** 

ro 

ID 

CM 

O 

00 

O 

in 

CM 

VD 

00 

ro 

ON 

rH  VD 

in 

u 

fO 

00 

00 

in 

rH 

CM  ro 

C7V 

m 

VD 

VD 

ro 

00 

o 

O VD 

CM 

p^ 

0 

C 

<y» 

\D 

CM 

o 

VD 

CM 

O 

r- 

CM 

rH 

in  r*' 

ro 

• 

MH 

(N 

rH 

rH 

CM 

rH 

rH 

rH 

CM 

rH 

rH 

rH 

CM 

rH 

rH  rH 

CM 

II 

^3 

a) 

♦ 

04 

N 

00 

in  00 

rH 

O OV  CO 

a\  ^ 

00 

in 

rH  CO 

VD 

VH 

(0 

m 

'D 

o r*' 

CM 

CM 

in 

rH 

o 

OV 

ro 

CO 

CO 

CM  in 

ON 

0 

CN 

ON 

ON 

n 

in 

in 

00 

<T\ 

o 

<T»  CO 

CO 

^ p^ 

c 

4H 

ID 

o 

CM 

o 

r- 

ro 

P-* 

rH 

CO 

ro 

00  rH 

00 

<6 

U) 

0 

rH 

rH 

CM 

CM 

rH 

CM 

CM 

CM 

CM 

rH  CM 

CM 

c 

S 

(D 

a 

1 

0> 

(N 

VD 

CM 

VD 

o 

ro 

P** 

P^ 

00 

ON 

(TN 

r*- 

VD 

c 

m 

00 

00 

VD 

(N 

VD 

r*' 

O 

o 

(it 

1— ( 

o 

0^  VD 

f*' 

00  r** 

m 

i/> 

CM 

rH 

o r*» 

00 

> 

VD 

VD  ro 

00 

00 

P^ 

ON 

ON 

00 

m ON 

ON 

•H 

On 

4J 

(0 

fN 

CM 

ro 

rH  CM 

CM 

ro 

CM 

CM 

CO 

CM  CM 

ro 

(U 

c 

8 

)i 

•H 

c 

& 

0 

§ 

•H 

ID 

00 

ON 

■s 

t 

a 

3 

e 

CRITICAL  PATH  ANALYSIS  IN  STOCHASTIC  NBIWORKS:  STATISTICAL  PERT 


j 


ty  R.  L.  SIELKEN,  JR. , H.  0.  HARTLEY  AND  E.  ARSEVEN* 
Texas  A and  M UniveAS^y 


AbstAacX.  This  p^)er  describes  a coiprehensive  new  procedure  for 
obtaining  information  about  the  distributicn  of  a project's  ccm- 
pleticn  time  vtei  the  project  is  ccrprised  of  a large  nuirber  of 
activities  and  the  time  required  to  oonplete  an  individual  activ- 
ity is  a randan  variable.  The  project  is  represented  as  an  acyc- 
lic network  whose  arcs  correspond  to  the  project's  activities. 
This  network  is  siitplified  ty  replacing  various  activity  ccaifigu- 
raticns  (blocks  of  activities)  by  single  equivalait  activities. 
The  network  is  then  decorposed  into  several  sub-networks.  The 
distribution  and  moments  of  each  sub-networks  conpletion  time  are 
bounded  and  approximated  on  the  basis  of  two  percentiles  from 
each  activity's  conpletion  time  distribution  by  using  a new  re- 
sult in  the  theory  of  networks.  The  project's  ccnpleticn  time 
distributicn  is  then  ^proKimated  by  combining  the  approximate 
sub-network  distributions. 

This  paper  represents  a condensation  of  the  five  technical 
reports  (see  list  of  references)  prepared  under  a research  con- 
tract for  the  Office  of  Naval  Research  ard  titled  "Cptimizaticn 
Research. " More  specifically  it  has  been  necessary  to  omit  from 
this  ccxidensaticn  all  aspects  concerned  with  the  "optimization" 
of  the  PERT  Networks:  The  well-known  technique  in  deterministic 
PERT  known  under  the  name  of  "oonpression"  postulates  convex  cost 
functions  for  the  ccnpleticn  of  each  individual  activity.  This 
procedure  has  beoi  generalized  and  catibined  with  statistical  PERT 
and  the  above  named  technical  r^xirts  provide  a means  of  minimiz- 
ing the  cost  of  the  conpletion  of  the  project  subject  to  a speci- 

♦Report  based  on  research  sponsored  1^  the  Operations  Research 
Division  of  the  Office  of  Naval  Research. 
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fied  schedule  for  either  the  e^^Jected  oonpletion  time  of  the 
project  or  an  upper  p)ercentile  for  the  ccnpletion  time.  Gener- 
alizaticns  to  monitoring  the  progress  of  a project  at  an  inter- 
mediate E^se  are  also  given  vrfiich  cptimize  in  a similar  manner 
that  p>art  of  the  project  not  as  yet  ocnpleted  at  the  time  of 
monitoring.  For  details  of  these  techniques  reference  is  again 
itade  to  the  technical  repxarts. 

Finally,  oonputer  programs  are  available  by  courtesy  of  the 
Office  of  Naval  Research  frcm  Dr.  R.  L.  Sielken,  Jr. , Institute 
of  Statistics,  Texas  A&M  University,  College  Station,  Texas  77843. 

The  well-kncwn  Program  Evaluaticai  and  Iteview  Technique  (PERT) 
is  concerned  with  a 'project'  oonprised  of  a large  nvanber  of 
'activities'  vhich  are  arranged  as  the  arcs  in  an  acyclic  network 
(see  e.g.  Figure  2) . The  activities  at  any  network  node  'catmerce' 
as  soon  as  all  activities  'terminating'  at  that  node  are  conpleted. 
The  time  required  to  coiplete  an  activity  cmce  it  can  be  begun  is 
a randan  variable,  and  hence  the  time  needed  to  coiplet  the  en- 
tire project  is  also  a randan  variable.  The  purpose  of  this  peper 
is  to  describe  and  illustrate  sane  new  methods  for  obtaining  in- 
fontBtion  caiceming  the  project  coipletion  time  and  its  distri- 
bution. 

The  classical  PEIiT  approach  is  to  replace  each  individual 
activity's  random  catpletiai  time  by  its  itean,  and  then  use  the 
project  oorpler.ion  tine  for  this  detenninistic  network  as  an 
approximation  co  the  mean  catpletion  time  for  the  entire  project. 

It  is  well-known  that  this  approxinaticn  nay  seriously  under- 
estiirate  the  mean  project  ocrpleticn  time  (see  e.g.  [1]).  An- 
other shortooming  of  the  classical  PERT  approach  is  that  it 
provided  no  information  about  the  distrubiticn  of  the  project 
oonpleticn  time  other  than  an  approxim  ation  of  the  itean  com- 
pletion time. 

The  relationship  of  the  project  completion  time  to  critical 
piath  methodology  of  course  stems  frcm  the  fact  that,  for  a given 
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sample  of  activity  caipleticn  times,  the  project  catpletion  time 
equals  the  time  to  travel  the  longest  path  through  the  network. 

The  longest  path  in  this  instance  would  ccmcaily  be  called  the 
"critical  path". 

1.0  A GeneAaZ  Si/nopi^  Oli  the  P>iopoie.d  P-fLOceduAe.  The  proposed 
approach  to  obtaining  information  cm  a project's  catpletion  time 
distribution  involves  the  following  five  general  steps: 

Step  1.  Identification:  Itepresent  the  project  and  its  ocnponent 
activities  in  terms  of  an  acyclic  network  with  one  source 
and  one  sink.  Identify  each  activity's  ccnpletiai  time 
distributicn  or  at  least  two  p)erc:entiles  of  each  activi- 
ty's  catpletion  time  distribution. 

Step  2.  Siitplifi(3aticn:  Replace  various  activity  cxmfigurations 
and  their  asscciated  catpletion  time  distributicms  by 
single  equivalent  activities  and  cxitpletion  time  distri- 
butions. 

Step  3.  Decxjtposition;  Decatpose  the  siitplified  network  into 

several  sub-networks  by  septarating  parallel  sub-networks 
and  then  separating  the  resulting  sub-networks  at  each 
cut  vertex.  A cnt  vertex  is  any  ncode  svoh  that  every 
path  from  the  source  to  the  sink  passes  through  it. 

Step  4.  Analysis:  Analyze  each  sub-network  arising  from  St^  3 
on  the  basis  of  two  percentiles  from  each  cxrponent 
activity's  conpletion  time  distributicn.  The  result  of 
this  analysis  is  an  approximation  of  each  sub-network's 
cxrpleticn  time  distributicn  and  the  manaits  of  this 
distribution. 

Step  5.  Synthesis:  CXmbine  the  approximate  sub-network  cxatple- 

ticn  time  distributions  determined  in  Step  4.  The  result 
is  an  approximate  cxitpletion  time  distribution  fc«r  the 
entire  project. 

2.0  S-imiptHii-Lng  thz  InUMit  Vfioizjut  NzXuionk.  Five  activity  con- 
figurations for  vdiicdi  a single  ecjuivalent  activity  and  cxaiple- 
tion  time  distributicn  are  readily  available  are  (1)  two  activi- 
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ties  in  series,  (2)  several  activities  in  parallel,  (3)  five 
activities  arranged  in  a "Wheatstone  Bridge",  (4)  eight  activi- 
ties arranged  in  a "Double  Wheatstone  Bridge",  and  (5)  seven 
cictivities  arranged  in  a "Criss-Cross".  These  activity  config- 
urations are  illustrated  in  Figure  1.  Itie  equivalent  single 
activity  ccrpleticn  time  distributions  for  configurations  1-3 
were  originally  identified  by  Hartley  and  WOrtham  [1]  and  for 
configurations  4-5  by  Ringer  [2]. 

3.0  oi(  a Sub-neXu)o'ik,  The  analytical  procedure  de- 
scribed in  this  section  yields  the  following  infomation  on 
each  sub-network  vhen  each  corponent  activity's  completion  time 
distrubition  is  r^laced  by  a discrete  two-point  distribution 
with  equal  prdoability  at  each  of  two  percentiles: 

(a)  upper  and  lower  bounds  on  the  mean  sub-network  com- 
pletion time  as  well  as  the  other  moments  of  the  sub- 
network completion  time; 

(b)  ipper  and  lower  bounds  on  the  distribution  functi<xi  of 
the  sub-network  completion  time;  ard 

(c)  an  approximate  distribution  function  of  the  sub-network 
completion  time. 

The  analysis  of  each  sub-network  involves  essentially  two 
parts: 

1.  The  formation  of  "clusters"  of  activities  whose  effects 
cai  the  sub-netwirk  completion  time  seem  to  be  interre- 
lated. 

2.  The  ^roximation  of  the  sub-network  cotpletion  time 
distribution  and  nanents  on  the  basis  of  the  clusters. 

3.1  FoAtnaXcon  oif  CluiteAh . The  actual  coipleticn  time  distri- 
hution  of  each  individual  activity.  A,  in  the  sub-network  is  re- 
placed by  a discrete  distribution  with  probability  1/2  at  the 
lower  percentile,  and  1/2  at  the  upper  percentile,  u^.  These 

will  be  sub-netwDrk  completion  time  (a  critical  path  time) . The 
r-th  moment  of  these  2"  times  will  be  denoted  by  T^,  and  the 
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distribution  function  of  these  times  vidll  be  denoted  by  F.  The 
approocijnaticn  of  the  T^'s  (especially  the  mean)  ard  F is  the 
goal  of  the  aataetvork  analysis.  Since  n will  usually  be  fairly 
large,  the  coiplete  enumeration  of  the  2*^  critical  path  times 
will  usually  be  unreascmably.  Hence  the  activities  which  are 
most  likely  to  be  on  the  critical  path  through  the  sutaietwork 
are  identified  and  their  joint  behavior  investigated. 

The  "mid-point"  of  the  conpletion  tine  distribution  for 
activity  A is  defined  to  be  m^  = + u^)/2.  The  percentile 

difference  u^  - is  denoted  by  d^  and  is  assured  to  be 

positive.  The  subnetwork's  critical  path  when  each  activity's 
corpletion  tine  is  set  equal  to  its  mid-point  will  be  referred 
to  as  the  "original"  critical  path.  The  ao^'vities  on  this 
critical  path  will  be  referred  to  as  "critical  activities"  with 
K equalling  the  number  of  such  activities. 

Sane  non-critical  activities  might  became  critical  if  sane 
of  the  conpletion  times  for  the  original  critical  activities  were 
decreased.  These  activities  are  identified  as  follows.  The  con- 
pletion  time  for  one  critical  activity,  say  A,  is  set  equal  to 

0}  vihere  \ is  a non-negative  algorithn  parameter 

vhich  the  user  specifies.  All  other  completion  times  are  set 
equal  to  their  mid-points.  Then  the  longest  path  through  the 
resulting  network  is  determined.  Any  activities  on  this  path 
vhich  were  not  on  the  original  critical  path  are  now  referred  to 
as  the  "associates"  of  A since  the  effect  of  these  "associates" 
on  the  networks'  conpletion  time  is  related  to  A's  catpletion 
time.  This  procedure  is  repeated  for  each  original  critical 
activity. 

Each  critical  activity  and  its  associates  make  one 
"cluster".  These  K initial  clusters  are  now  "pooled”  by  can- 
bining  any  two  clusters  with  at  least  one  activity  in  ccmon. 

In  general  there  will  still  be  more  than  one  cluster,  and  mai^ 
of  the  n - K non-critical  activities  will  not  occur  in  any 
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The  associates  correspond  to  the  activities  which  become 
critical  v»iien  the  ccnpleticn  tines  of  the  original  critical 
activities  are  lowered.  However,  sene  of  the  originally  non- 
critical  activities  nay  also  becone  critical  if  their  oorpletion 
tines  exceed  their  mid-points  and  the  oorpletion  times  of  the  ori- 
ginal critical  activities  are  at  their  mid-points.  These  acti- 
vities are  identified  next.  Each  originally  non-Ciitical 
activity  is  investigated  separately.  If  activity  A is  being  inves- 
tigated, then  the  oorpletion  time  for  A is  set  equal  to  m^  + ed^ 

vitere  3 is  a non-negative  algorithm  parameter  vhich  the  user 
specifies.  The  cxrpletion  times  for  all  other  activities  are  set 
equal  to  their  mid-points,  and  the  corresponding  critical  path 
determined.  This  critical  path  will  either  be  the  original  cri- 
tical path  or  a nsrf  path  vhich  includes  A.  In  the  latter  case, 
the  activities  on  the  original  critical  path  which  are  not  on  the 
new  critical  path  cxxitaining  A are  called  the  "eliminants"  of  A. 
Thus,  the  effect  of  A's  eliminants  on  the  networks  cxrpletion 
time  is  related  to  the  oorpletion  tire  for  A.  Henca,  A is  added 
to  any  cluster  vhich  emtains  at  least  cne  of  A's  eliminants. 

After  this  procedure  has  been  repeated  for  each  originally  non- 
critical  activity,  the  resultant  clusters  are  "pcxiled"  again  by 
cxarfcining  any  two  clusters  with  at  least  one  activity  in  cxnron. 

Althou^  the  mitiber  of  clusters  is  reduced  vhen  the  pooling 
cai  the  basis  of  the  associates  cxxnrcs  and  then  further  reducad  vhen 
the  pooling  on  the  basis  of  the  eliminants  ocxxrs,  there  vd.ll 
generally  remain  more  than  one  cluster  and  several  activities  not 
in  any  cluster. 

In  general  the  larger  the  values  of  X aid  0 the  greater  the 
nurrber  of  activities  in  the  clusters  and  the  smaller  the  nunfcer 
of  clusters.  In  particxilar  the  preoedure  for  forming  the  clusters 
has  the  following  properties: 

Pn^rty  1:  If  X2  > Xj^,  then  any  activity  vhich  would  be  an 
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associate  of  a critical  activity  A when  X = 
would  also  be  an  associate  of  A when  X = 


Property  2:  If  62  > 0]^,  then  any  critical  activity  viiich  would  be 

an  eliminant  of  a non-critical  activity  A \dien 
e = would  also  be  an  eliminant  of  A idien 

0 = 02- 

Property  3:  For  any  originally  non-critical  activity  A there 
exists  0^  such  that  A will  have  sane  eliminants 

for  any  0 ^ 0^. 

Prcperty  4:  For  any  fixed  value  of  X,  the  set  of  activities  in 
the  union  of  the  clusters  is  monotonically  non- 
decreasing as  0 

Prcperty  5;  Ihere  exists  a finite  value  0*  such  that  if  0 > 0* 
then  every  activity  would  be  in  sane  cluster. 

Property  6:  The  nxntser  of  clusters,  originally  K,  is  noi- 
increasing  as  0 

Property  7:  There  exists  a finite  value  0*  such  that  if  e ^ 0*, 
then  there  would  oily  be  one  cluster. 

Most  of  the  properties  of  the  cluster  formation  procedure 
are  fairly  straightforward;  however.  Property  7 requires  sane 
special  justificaticn.  This  justification  is  based  on  the 
follcwing  definiticn  and  theorem  which  is  proven  in  T^pendix  A. 
Definition:  In  any  acyclic  network  a bridge  over  any  two  con- 
secutive arcs  Aj^  and  A2  is  any  arc  A^  such  that  aU  paths  from  the 

source  to  the  sink  passing  throv^  Aj  do  not  pass  throu^  either 
or  A2. 


Theorem  1:  In  any  acyclic  network  with  no  ait  vertices  there  is 
at  least  caie  bridge  for  any  pair  of  cxmsecutive  arcs. 


3.2.1  A LouteA  Bound  on  T^.  For  each  cluster  C let  n„  denote  the 
A c 

nuirber  of  activities  in  C,  and  let  1^(0  denote  the  average  of 

n 

the  r^th  power  of  the  2 critical  path  times  vhen 

(a)  the  cdtpletion  time  for  each  activity  not  in  C is  equal 
to  its  mid-point,  and 

(b)  the  ociipleticn  times  for  the  activities  in  C are  at  each 

n 

c 

of  the  2 possible  combinations  of  their  upper  and 
lovrer  percentiles. 

Let 

T"(e,  A)  = max  T*(C) 

^ C 

vhich  d^aends  on  0 and  A since  the  ccnpositioi  and  number  of  clu- 
sters depends  on  0 and  A. 

The  following  two  theorems  are  easily  proven  and  are  used  in 
proving  that  T“(0,  A)  is  a lower  bound  for  T^. 

Theorem  2;  For  any  cluster  C,  einy  positive  integer,  and  any 
activity  A not  in  C, 

T*(C  U {A})  > T*(C)  . 

Theorem  3:  For  any  two  clusters  and  C2  and  any  positive  integer 
r, 

1*(CiU  C2)  > max{T*(Cj^),  T*(C2)}  . 

Property  2 of  the  cluster  formation  procedure  inplies  that  if 
0 is  increased  the  clusters  expand  or  are  pooled.  Thus,  Theorems 
2 and  3 imply  that,  for  fixed  A,  T^(0,  A)  is  non-decreasing  as 

0 increases.  Furthermore,  Properties  5 and  7 together  imply  that 
for  0 sufficiently  large  there  is  only  one  cluster  and  all  of  sub- 
network activities  are  in  that  cluster.  Herxje,  for  e sufficiently 
large  T^(0,  A)  = T^,  euid  the  following  theorem  is  true: 

Theorem  4: 

(a)  T^(0,  A)  is  a non-decreasing  function  of  0 for  any  fixed 
values  of  A and  r; 

(b)  there  exists  a finite  value  0*  such  that  0 > 0*  iitplies 

t“(0,  a)  = T 
r r 
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for  any  X,  and  r;  ard 
(c)  for  any  e.  A,  and  r 

t"(0,  A)  < Tj.. 

3.2.2  An  UppeA.  Bound  on  and  a LoweA  Bound  on  F.  Let  n^ 

denote  the  nuntaer  of  activities  in  the  union  of  all  the  clusters, 
and  let  T^(e,  A)  denote  the  average  of  the  r-th  power  of  the 

n 

2 critical  path  times  vAien 

(a)  the  conpletion  time  for  each  activity  not  in  the  unicai 
of  the  clusters  is  equal  to  its  upper  percentile,  and 

(b)  the  conpletion  times  for  the  activities  in  the  union  of 

n 

the  clusters  are  at  each  of  the  2 possible  confcina- 
ticns  of  their  ipper  and  lower  percentiles. 

An  au^gment  analogous  to  that  used  to  prove  Iheoran  4 leads  to  the 
following  result: 

Theorem  5: 

(a)  T^(9,  A)  is  a non- increasing  function  of  9 for  any  fixed 
values  of  A and  r; 

* it 

(b)  there  exists  a finite  value  9 such  that  0^9  inplies 

T^(0,  A)  = 

for  any  A and  r;  and 

(c)  for  any  0,  A,  and  r 

Tj.  £T^(0,  1)  . 

Let  F (•;9,  A)  denote  the  enpirical  distribution  function  of 

n ^ 

2 critical  path  times  used  to  oorpute  T^(0,  A).  That  is,  let 

n 

F (t;  9,  A)  denote  the  preportion  2 ^ critical  path  times  deter- 
mined in  the  oonputation  of  the  1^(0,  A)  's  that  are  less  than  or 

equal  to  t.  Then,  using  Propexiy  2,  it  follows  that: 

Theorem  6:  For  any  values  of  A and  t,  F (t:  9,  A)  is  a non- 
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decreasing  function  of  0. 

Theorem  6 and  Property  5 cotitoined  yield  Theorem  7. 

Theorgn  7; 

(a)  There  exists  a finite  value  0*  such  that  0^0*  inplies 
F"(t;  0,  \)  = F(t) 

for  every  t and  any  X;  and 

(b)  for  any  0,  X,  and  t 
F“(t;  0,  X)  < F(t)  . 

3.2.3  An  UppM.  Bound  on  F.  Let  F''’(*;  0,  X)  denote  the  empirical 

n 

distribution  fvaicticn  of  the  2 critical  path  times  when 

(a)  the  ccnpletion  time  for  each  activity  not  in  the  unicsi 
of  the  clusters  is  equal  to  its  Icwer  percentile,  and 

(b)  the  oonpleticn  times  for  the  activities  in  the  union  of 

n 

the  clusters  are  at  each  of  the  2 possible  coitbina- 
tions  of  their  uLper  and  lower  percentiles. 

An  argunent  analogous  to  that  used  to  prove  Theorems  6 and  7 
yields  the  following  theorem: 

Theorem  8: 

(a)  F^(t;  0,  X)  is  a non- increasing  fimction  of  0 for  every 
t and  any  X ; 

(b)  there  exists  a finite  value  0*  such  that  0^0*  implies 
F+(t;  0,  X)  = F(t) 

for  every  t and  X;  and 

(c)  for  any  0,  X,  and  t 

I e,  X)  > F(t) 

3.2.4  Simncviy.  Theorems  2-8  together  imply  that  for  any  value 
of  0 and  X chosen  by  the  algorithm  user: 

(a)  T^(0,  X)  £ » for  any  positive  interger  r; 

cind 

(b)  F (t;  0,  X)  £F(t)  £F'*'(t;  0,  X)  for  any  t. 

They  also  imply  that,  for  any  r,  X,  and  t, 

T+(0,  X)  - t“(0,  X) 
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and 

F'^(t;  e.  A)  - F~(t;  0,  A) 

would  decrease  monotcnically  to  zero  if  6 were  increased.  In 
fact,  Theorems  2-8  inply  that  there  exists  a value  e*  which 
doesn't  depend  on  r.  A,  or  t such  that  9^6*  inplies  that 


T“(e,  A)  = = T+(e,  A) 


and 


F"(t;  0,  A)  = F(t)  =F  (t;  0,  A). 

A reasonable  afpraximation  for  F(t)  is 

F*(t;  0,  A)  = l/2[F"(t;  0,  A)  + F+(t;  0,  A)  ] . 

4,0  Sifnthei-Lzinq  thz  App-tox^cmo^e  SubneXmAk  Complexion  Timz 
VLit/u-buttoni . When  the  original  network  is  decorposed  in  Step  3, 
the  result  is  a netwDrk  of  subnetworks  with  any  two  subnet>rorks 
either  in  series  or  in  parallel.  Let  and  S2  be  any  two  sub- 
networks, and  let  the  corresponding  approximate  corpletion  time 
distributions  be  denoted  by  F*  and  F*.  If  and  S2  are  in 

series,  then  the  conpletion  time  distribution  for  cind  S2  cxan- 
bined  is 


F*(t)  = Z F*(t  - s)  f*(s) 
s<t 


(4.1) 


= Z F (t  - s)  f-  (s)  . 

s<t 


vihere  f and  f2  are  the  discrete  probability  density  functions 
corresponding  to  F*  and  F*  respectively.  If  and  S2  are  in 
parallel,  then  the  ocmpletion  time  distribution  for  Sj^  aixi  S2 
conbined  is 


F (t)  = F*(t)  • F2(t) 


(4.2) 


I 


procedure  introduced  in  section  2,  the  network  in  Figure  2 will  be 
analyzed. 

Assuming  that  at  least  two  percentiles  of  each  activity's 
ccrpleticn  time  distribution  have  been  identified,  the  follcwing 
initial  sinplifications  can  be  made: 

(1)  replace  activities  li  - I5  (a  Wheatstone  Bridge)  by  a 
single  activity,  say  1^; 

(2)  replace  activities  le  - I13  (a  Double  Wheatstcne  Bridge) 
by  a single  activity,  say  Ij^;  and 

(3)  replace  activities  I14  - I20  (a  Criss-Cross)  by  a single 
activity,  say  1^. 

These  initial  sinplifications  lead  to  still  further  sinplifica- 
ticsis  since  the  new  activities  1^  and  Ij^  would  be  in  parallel  and 

hence  could  be  replaced  by  a single  activity,  say  1^;  and  then 
finally  since  1^  and  1^  would  be  in  series  they  too  could  be 

replaced  by  a single  activity,  say  1.  The  resulting  sinplified 
network  is  given  in  Figure  3. 

The  sinplified  network  can  be  deoatposed  into  the  three  sub- 
networks idiich  are  circles  in  Figure  3.  For  identification 
purposes,  activities  1-5  will  be  called  the  first  subnetwork, 
activities  6-16  the  second  subnetwork,  and  activities  17  - 30 
the  third  subnetwork. 

Using  the  methods  described  in  section  3,  the  three  sub- 
networks are  ancilyzed  separately  on  the  basis  of  two  percentiles 
from  each  activity's  individual  ocrpletion  time  distributicai.  Of 
course,  these  cinalyses  depend  upon  the  values  of  (9,  X)  specified 
by  the  investigator.  The  value  of  (9,  X)  need  not  be  the  same 
for  cill  three  subnetworks. 

The  three  approximate  subnetwork  ccnpletion  time  distribu- 
tioTS  are  then  synthesized  using  (4.1)  and  (4.2).  In  particulcur, 
since  the  first  and  second  subnetworks  are  in  parallel,  their  res- 
pective cotipleticn  time  distributions  can  be  ccnbined  using  (4.2)- 


178 


Then,  since  the  conbination  of  the  first  and  second  subnetworks 
is  in  series  with  the  third  sulnetvrork,  the  ccitpletion  tune  dis- 
tribution for  the  entire  network  can  be  found  using  (4.1) . 

6.0  ConcIucUnq  Rena^ki.  The  proposed  procedure  for  investigating 
the  project  oonpletion  time  distribution  involves  five  general 
steps:  (1)  Identification,  (2)  Suiplification,  (3)  Deoonpo- 
sition,  (4)  Analysis,  and  (5)  Synthesis.  The  necessity  and 
value  of  these  steps  are  obvious,  eind  certainly  the  implementa- 
tion of  Steps  1,  2,  3 and  5 is  straightforward.  However,  Step  4 
involves  several  ohoioes  vrfiicfi  merit  sane  additional  discussion. 

The  analysis  of  the  network  oonpletion  time  is  based  on  two 
percentiles  of  each  activity's  ocrpletion  time  distribution. 
Cbviovjsly  the  analyst  would  have  more  information  to  work  with  if 
he  had  each  activity's  entire  oonpletion  time  distribution,  but 
such  cxnplete  informaticai  is  seldom  available.  TWo  peroentiles 
are  mich  more  likely  to  be  obtainable  and  therefore  r^iresent  a 
cxnprxmise  between  the  analyst's  desires  and  pracdrcal  reality. 
Furthermore  several  Monte  Carlo  investigations  have  suggested  that 
essenticdly  as  much  information  can  be  gained  using  a reasonable 
pair  of  peroentiles  as  could  be  chtained  using  every  acd:ivity's 
entire  cmpletion  time  distribution.  A "reeisonable"  choice  for 
the  pair  of  peroentiles  seans  to  be  either  (15,  85) , (20,  80) , or 
(25,  75).  In  fact,  if  the  oonpletion  time  distributicns  of  the 
individual  activities  were  incSependent  Jicrmal  distributions,  then 
a choice  of  the  15-th  and  the  85-th  peroentiles  would  be  rou^ly 
the  mean  minus  one  standard  deviation  and  the  mean  plus  one  stan- 
(iard  cteviation,  so  that  the  means,  varianc:es,  and  covariances  of 
the  activities  and  paths  would  be  the  same  using  the  two-point 
distributions  as  they  would  be  using  the  entire  distributions. 

In  the  sulaietwork  analysis  procedure  the  effect  of  the  non- 
ctitical  path  activities  is  ascjertained  by  letting  their  cxrple- 
ticn  times  be  the  mid-points  of  their  upper  and  Icwer  percentiles 
plus  and  minus  6 times  their  percentile  differences  and  by  letting 
the  odipleticn  tines  of  the  critical  path  activities  be  their 
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mid-points  minus  X times  their  percentile  differences.  If  the 
upper  and  lower  percentiles  were  the  15-th  and  85-th  percentiles 
of  a norrral  distribution,  then  the  percentile  difference  would  be 
approxiitately  2 standard  deviaticsis.  Thus,  6 and  X always 
refer  to  roughly  "so  many  standard  deviaticais" . Hence  it  seems 
reasonable  to  only  consider  values  of  6 and  X in  the  interval 
[0,  3]  and  caimonly  less  than  2.  It  is  difficult  to  predict  in 
general  the  cluster  sizes  for  any  particular  values  of  e and 
X.  (Of  course  as  e and  X increase,  the  cluster  sizes  increase 
as  indicated  by  Properties  1-7  in  Section  3.)  On  the  other  hand, 
it  is  not  necessary  to  have  large  cluster  sizes  in  order  to  obtain 
a reasonable  approximation  to  the  subnetwork’s  coipletion  time 
distributioi. 

Although  the  cluster  formation  procedure  considers  activity 
cdipletion  times  of  the  mid-point  plus  or  minus  0 or  X times 
the  percentile  difference,  it  could  have  also  used  plus  or  minus 
0 or  X times  the  standard  deviation  or  any  other  indicator  of 
the  dispersion  in  the  activity's  coipleticai  time  distribution.  A 
modification  of  this  type  would  not  change  the  theoretical  results 
givai  in  Secticxi  4 at  all. 

If  the  nurber  of  activities  in  a cluster,  n^,  is  moderately 

ric 

large,  the  nattier  of  percentile  ccmbinations,  2 , to  be  consid- 

ered is  quite  large.  Since  all  the  clusters  are  pooled  into  one 
cluster  when  the  T^'s,  F~,  and  F'*'  are  determined,  the  problem  of 

a large  value  of  2^  may  occur  without  (0,  X)  being  unreason- 
ably large.  If  this  problem  arises,  a reasonable  modification  in 

the  subnetwork  analysis  procedure  is  to  evaluate  only  a randcm 
n„ 

sample  of  the  2 possible  percentile  combinations.  Another 
modification  in  the  subnetwork  analysis  procedure  which  may  be 
imde  when  the  cluster  sizes  become  large  is  the  deletion  of  the 
calculation  of  f'*’.  This  deletion  is  not  unreasonable  since  the 
differences  between  F and  F^  are  usually  only  very  snail 
even  for  small  values  of  0 and  X . Furthermore  what  differences 
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there  are  appear  alnost  entirely  in  the  lower  percentiles  of  F“ 
and  F^.  When  large  clusters  are  involved,  the  deletion  of  F^ 
will  cut  the  coiputation  time  nearly  in  half. 

There  are  several  advantages  to  the  proposed  procedure  over 
a sirtple  Monte  Carlo  study  of  the  project  ccrpleticai  time.  First, 
the  sinplificaticxi  step  usually  makes  a substantial  reduction  in 
the  size  of  the  project  network  - often  a reduction  exceeding  50%. 
Then  the  subnetwork  analysis  procedure  provides  information  in 
terms  of  "associates"  and  "eliminants"  about  v^iich  activities  play 
an  important  role  in  determining  the  subnetwork's  ccrpleticai  time. 
This  informaticai  also  provides  seme  indication  of  the  effects  of 
changing  varicais  activity  cxmpleticai  time  distributions.  Further- 
itore,  when  the  upper  and  lcai?er  bounds  and  other  approximatiens 
are  being  obtained,  the  ccrputational  effort  is  ccaicentrated  on 
those  activities  vdiich  are  most  likely  to  affect  the  network's 
cxaipletion  time  distribution  by  only  varying  their  cxrpletion 
times  instead  of  unnecessarily  varying  all  of  the  network's  activ- 
ity cxrpleticai  times. 

Corputer  programs  inplanenting  the  gaieral  procedure  are 
available  frem  R.  L.  Sielken  Jr.  These  programs  were  written  in 
Fortran  IV  and  used  on  ein  IBM  360/65.  The  largest  network  analy- 
zed thus  far  contained  approximately  680  activities  and  250  nodes. 
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APPEEDIX 


Proof  of  Theorem  1 


The  netvrorks  considered  in  this  appendix  are  assumed  to  be 
acyclic,  have  no  cut  vertices,  and  have  one  source  and  one  sink. 
Also  the  two  arcs  A^  and  A2  are  any  two  adjacent  (consecutive) 
arcs  with  A^^  preceding  A2. 

Definition  1:  A bridge  over  A^  and  A2  is  an  arc,  say  A^/  such 
that  all  paths  fron  the  source  to  the  sink  passing  through  A^  do 
not  pass  through  either  Aj^  or  A2. 

Definition  2:  An  origin  violator  of  Aj^  and  A2  is  an  arc,  say  A^, 


such  that  there  exists  a path  fron  the  terminal  node  of  A^^  to  the 


sink  v^ch  passes  through  A^. 

Definition  3:  A terminal  violator  of  Aj^  and  A2  is  an  arc,  say  A^, 


such  that  there  exists  a path  from  the  source  to  the  terminal 


node  of  Aj^  vMch  passes  through  A^. 


An  intuitive  feeling  for  these  definitions  can  be  obtained 
by  considering  Figure  4. 

Ttie  following  three  lanmas  are  straightforward  consequences 
of  the  definitions  of  a bridge,  an  origin  violator,  and  a terminal 
violator. 

Lemna  1:  Every  branch  in  the  netvrork  is  either  a bridge  over 
and  A2,  an  origin  violator  of  and  A^,  or  a terminal  violator 
of  Aj^  and  A2. 

Lgima  2:  A^  is  a terminal  violator  of  A^  and  A2,  and  A2  is  an 
origin  violator  of  Aj^  and  A2. 

Latina  3:  Any  arc  A^  cannot  be  both  an  origin  violator  of  Aj^  and 
A2  and  a terminal  violator  of  ctnd  A2. 

Theorem  1:  In  any  acyclic  network  with  no  cut  vertices  there  is 
at  least  one  bridge  for  any  pair  of  consecutive  arcs. 

Proof  of  Theorem  1:  Since  the  terminal  node  of  A^  cannot  be  a 

cut  vertex,  there  exists  a path  P frcm  the  source  to  the  sink 
which  does  not  pass  through  the  terminal  node  of  Aj^.  Denote  the 

arcs  on  P by  C^,  C2,  ...,  Cp  with  C^_-^  preceding  on  P. 

SuRXjse  that  none  of  C2»  •••/  Cp  are  bridges  over  A^^  and 
A2.  Then  LeititH  1 and  Lenra  3 together  iirply  that  each  of 

C2,  ...,  Cp  is  either  an  origin  violator  of  A^^  and  A2  or  a 
terminal  violator  of  A^  and  A^  but  not  both.  Since  the  origin 
node  of  is  the  source,  cannot  be  an  origin  violator  and 

must  be  a terminal  violator.  Similarly,  since  the  terminal  node 

of  C is  the  sink,  C cannot  be  a terminal  violator  and  must  be 
P P 

an  origin  violator.  Hence,  there  exists  j ^ 1 such  that 

^1'  ^2'  ■ " ' '"j  terminal  violators  and  C is  an  origin 

violator. 
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since  Cj  is  a terminal  violator,  there  exists  a path  frcri 
the  terminal  nocie  of  Cj  to  the  terminal  node  of  A^.  Furthermore, 
since  is  an  origin  violator,  there  is  a path  fran  the  termi- 
nal node  of  to  the  origin  node  of  (the  terminal  node  of 

Cj).  These  two  paths  imply  the  existence  of  a circuit  fran  the 
terminal  node  of  Cj  to  the  terminal  node  of  A^  and  then  back  to 
the  terminal  node  of  Cj.  (The  definition  of  P inplies  that  the 
terminal  node  of  Cj  is  not  the  terminal  node  of  A^^.)  This  con- 
tradicts the  given  acyclic  structure  of  the  network  and  ccnpletes 
the  proof  of  Theorem  1. 
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Activities  in  Parallel 


Two  Activities  in  Series 


Wheatstone  Bridge 


Double  Wheatstone  Bridge 


Criss-Cross  , Networks 


Figure  1.  Activity  configurations  which  can  be  simplified. 


Figure  2.  An  example  network 


Figure  4.  A network  illustrating  bridges,  origin  violators  and  terminal 


violators. 


BRIDGES  over  A.|  and  A^:  II,  I,  '1,  0,  P,  and  Q 

ORIGIN  VIOLATORS  of  A^  and  A^:  A^ , F,  G,  J,  K,  R,  and  S 

TERMINAL  VIOLATORS  OF  and  A^:  A^ , D,  E,  L,  and  M 
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Question:  I have  a question  for  Dr.  Hartley.  I am  trying,  but 
I can't  make  much  of  a connection  between  the  topic  here  \«hich  is 
the  decision  information  for  Camand  and  Control  and  the  interes- 
ting discussion  of  statistical  PEPfT.  I would  solicit  your  obser- 
vations based  on  the  discussion  given  yesterday  on  how  it  might 
be  applied.  Would  you  please  do  that  step  in  connecting  the 
generalized  work  with  the  talk  we  had  yesterday? 

Hartley:  I think  all  that  I can  tell  you  is  that  insofar  as  all 
these  operations  are  part  of  mybe  PERT  is  of  sane  help  for 
the  auxiliary  operations  providing  the  timing  of  equipment  you 
require.  That  if  you  are,  for  exanple,  using  PERT  operations  for 
optimizing  the  activity  in  a theatre.  But  I will  admit  that  I 
am  not  aware  - maybe  other  people  are  - of  any  application  that 
is  directly  concerned  with  oeprations  or  the  ware  positioi. 

Question:  It  seats  to  me  that  the  most  appropriate  thane  is  to 
maintain  cannunicaticns  networks.  Suppxose  vre  have  a catmunica- 
tions  network  with  nodes,  etc.  It  takes  time  - therefore  the 

money  - flowing  fran  one  node  to  another  for  canmunication  needs.  ‘ 

Generally  we  have  twro  or  three  alternative  networks  or  channels  i 

i 

to  bring  the  information  you  want  in  order  to  verify  or,  in  the  I 

case  of  wartime,  to  obtain  caimunicaticns.  Then  I think  there  j 

could  be  a way  to  estimate  the  final  cost.  This  is  the  best 
connection  I could  make  about  ccnmunications. 

Question:  I guess  a couple  of  things  concern  me  about  statisti- 
cal PERL'.  In  the  first  place  it  is  basically  an  activity  on 
those  networks  you  didn't  reflect  any  variation  in  branching 
logic.  Do  you  have  the  capability  to  handle  not  only  determinis- 
tic branching,  but,  probabilistic  and  conditional  branching  as 
well?  That's  question  number  one.  The  second  question  that  I 
have:  Can  you  handle  different  distribution  types  at  nodes 
f where  your  major  time  consutption  is  occurring? 

[ Hartley:  I will  answer  the  first  part  because  that  is  a problem 
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that  does  occur  sanetimes.  If  a particular  operation  in  the 
future  is  not  as  yet  decided  upon,  in  particular  hew  you  are  going 
to  accoqplish  it,  but  you  are  still  in  the  R&D  stage  of  concluding 
the  alternatives.  Eventually  you  will  make  a decision.  Hew  you 
plan  ahead  under  such  an  alternative?  Hois  is  feasible,  however, 
providing  you  are  accepting  the  probability  that  this  activity  is 
carried  out  by  Mode  "A"  or  Mode  "B".  There's  no  prctolam  about 
that.  Your  second  question  about  what  kind  of  distributions  are 
we  able  to  cope  with.  If  we  are  lucky  enough  and  data  base  is 
available  for  the  distribution  of  the  times  to  perform  a parti- 
cular operation  then  you  can  put  in  a numerical  table.  If,  how- 
ever, such  an  e:q)erience  is  lacking  it  is  custonary  to  use  Beta 
distribution.  I have  to  make  it  available  for  a limited  number 
of  alternatives. 

Question:  You  mentioned  about  transitive  models.  As  I understood 
it,  you  can  get  - in  using  the  sequence  of  models  a collection  of 
models  to  solve  problans,  instead  of  one  kind.  It  seems  to  me 
that  it  is  just  like  a building  being  in  operation.  You're  sug- 
gesting that  it  needs  a few  more  rules.  I think  that  is  is  just 
the  philosophy  that  is  missing  here  and  maybe  by  ccniplete  sub- 
mission he  will  cone  tp  with  new  bools  and  new  approaches  and 
better  knewn  abstractions.  I don't  disagree  with  anything  you 
have  said,  but  I den't  think  I said  enough  to  give  you  the  correct 
inpression  of  what  I do  at  the  University.  I am  not  saying  there 
is  no  need  for  a succession  models.  I am  just  saying  that  given 
whatever  decisicxi  you  are  looking  at,  one  has  to  be  prepared  to 
use  a variety  of  tools  in  the  decision  theory,  for  example,  if 
one  wants  to  look  at  optimal  rules,  the  normal  development  has 
cane  to  a halt  in  terms  of  what  you  can  say.  The  mathematics 
stops  you  at  a certain  point.  You  can  keep  on  writing  equations 
down  and  you  say  well,  I will  keep  on  solving  this  equation  - but 
that  is  not  very  useful  to  the  practitioner.  VIhat  I am  saying  is 
that  context,  for  exanple,  is  that,  to  itake  headway,  one  has  to 
go  beyond  that  and  say,  how  would  this  approximation  behave  in  a 
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real  environment  vrfiere  you  dai't  know  aU  the  data?  That  means 
that  you  are  not  only  involved  in  curve  fitting  techniques,  you 
are  involved  in  simulation  of  systans.  So  that  htat  I am  getting 
at  is  the  inclination  to  make  practical  a lot  of  the  model  build- 
ing ideas  that  have  been  around  - perhaps  new  decision  areas. 

The  research  scientist,  as  an  applied  Tiatheratician,  better  not 
be  an  expert  in  just  one  avenue. 

I 


I 


i 
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SOME  PHIDDSOPHICAL  VIEWS  Ol  ALGORITHMS 
AND  COMPITTING  METHODS  IN  APPLIED  MATHEMATICS 


by  ANGELO  MIELE 
nice  UniveuiXi/ 


j 

I 

I 


AbitAact.  This  p^Der  sunnarizes  some  of  the  work  done  by  the 
Aero-Astronautics  Group  of  Rice  University  in  the  area  of  numeri- 
cal methods  and  coiputing  methods,  it  describes  sate  of  the  phil- 
osophical thoughts  that  have  guided  this  work  throughout  the  years. 
Reccntnendaticms  are  offered  ccnceming  allocation  of  funds  and 
distribution  of  funds.  Additicmal  reccmendations  are  offered  in 
order  to  bridge  the  gap  between  the  top  management  of  government 
agencies  and  the  academic  comiunity. 

1 . 0 lutAoductton.  Colonel  Geesey,  General  Welch,  Professor 
Thrall,  Dr.  Andrews,  Ladies  and  Gentlemen: 

Over  the  past  several  days,  I have  heard  the  terms  C^  and 
C^  mentioned  so  many  times  by  so  many  speakers  that  I cannot 
avoid  the  feeling  of  being  an  ejpert  on  the  subject.  Yet,  was  I 
an  expert  on  the  subject  barely  three  days  ago?  Certainly  not. 

When  I first  glanced  at  the  program  and  saw  the  symbols  C^ 

and  C^  repeated  over  and  over,  I thought:  C^  must  denote  seme 
function  which  is  continuous  together  wdth  its  first  and  second 

derivatives;  analogously,  c^  itust  denote  sane  function  which  is 
continuous  together  with  its  first,  seeaxi,  and  third  derivatives. 
Then,  I thought:  What  are  the  ndlitary  up  to?  Why  are  they 
interested  in  functions  which  might  exhibit  a discontinuity  in 
the  fourth  derivative? 

After  listening  to  the  opening  speech  of  General  Welch,  it 
became  apparent  to  me  that  the  terms  C^  and  C^  were  being 
enployed  in  a context  quite  different  fron  that  familiar  to  pure 
and  applied  mathematicians.  After  glancing  again  at  the  program, 

I saw  that  one  of  the  papers  being  presented  had  the  title: 
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at  Sea;  A Camiaixier's  View.  Then,  I said  to  myself:  perhaps 


denotes  sate  new  kind  of  periscope,  or  atonic  submarine,  or 

periscope  mounted  on  seme  atonic  submarine. 

Obviously,  not  even  ray  secend  interpretation  was  correct, 

and  it  took  me  a full  day  to  establish  a minimun  of  familiarity 

with  the  jargon  of  generals  and  admirals.  Slowly,  but  surely,  by 

2 

the  end  of  the  day,  I finally  understood  that  C means  cctnmand 
and  control  and  that  means  cernnand,  control,  and  coimunica- 
tic*i. 

2.0  Exyiitcnce  oii  a Gap.  Allow  me  to  look  backv«rd  in  time  and 
glance  panoramically  at  the  cxxitent  of  this  three-day  meeting. 
After  listening  at  the  succession  of  presentations  given  by  gen- 
erals, admirals,  professors,  senior  scientists,  and  various  tech- 
nical personnel,  v*at  is  ny  overall  feeling?  VJhere  do  we  stand 
new? 

Scxnehow,  I have  the  impression  that  there  are  two  main  possi- 
bilities: (a)  perhaps,  the  wrong  people  were  invited  at  this 
meeting;  in  that  case,  I am  definitely  one  of  the  wrong  people; 
or  (b)  perhaps,  the  right  people  were  invited  at  this  meeting; 
in  that  case,  it  seems  apparent  that  a considerable  gap  exists 
between  the  top  management  of  the  military  on  one  side  and  the 
academic  people  on  the  other  side. 

Under  the  assvrption  that  interpretation  (b)  is  correct,  then 
the  best  thing  which  can  be  done  at  this  moment  is  to  make  an 
effort  in  order  to  bridge  the  gap.  With  this  in  mind,  I shall 
devote  the  rest  of  ny  lecture  to  presenting  rty  philosophical  views 
on  research  on  algorithms  and  computing  methods  in  applied  mathe- 
matics. In  particular,  I shall  focus  ny  attention  on  the  work  of 
the  Aero-Astronautics  Grotp  of  Rice  University.  After  this  pre- 
sentation is  ccitpleted,  then  each  of  you  can  make  vp  his  mind  as 

to  whether  (and  to  what  degree)  ny  work  fits  within  the  frame  of 
2 . 3 ■ ■ 

a C -situation  or  a C -situation.  While  I am  not  so  sure  that  ny 

2 3 

work  is  relevcint  to  the  C -point  of  view  amd/or  the  C -point  of 
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view,  nevertheless,  there  is  little  cJoubt  in  ray  mind  that  ny  vork  ^ 

is  relevant  to  AE  (meaning  aerospace  engineering) , ND  (meaning 
national  defense) , and  USA  (neaning  the  United  States  of  America) . 

3.0  Eng-LmeJiint)  First,  let  me  give  you  my  background.  I ! 

graduated  in  Aerospace  Engineering  fran  the  University  of  Rcme  in 

1946,  and  nv  initial  intenticxi  was  that  of  beccming  a designer  of 
all  sorts  of  aerospace  vehicles.  Since  the  Italian  industry  was 
in  total  shambles  in  1946  (we  had  lost  the  war) , I accepted  a 
jet)  at  the  Military  Aircraft  Factory  of  Cordoba,  Argentina.  The 
director  of  the  factory  was  Brigadier  General  I.  San  (tertin,  who 
had  studied  aerospace  engineering  in  Italy  at  the  Polytechnic  of 

Turin,  and  v*io  had  a very  soft  spot  in  his  heart  for  Italian  ! 

teclinical  personnel.  He  was  affectic»iately  called  "El  Petiso", 
meaning  the  short  one,  for  obvious  reasons. 

As  per  ray  wishes,  I was  given  several  design  assignments: 
first,  the  aerodynamic  design  of  a propeller;  next,  the  cenputa- 
tion  of  the  flight  performance  of  a training  plane;  then,  the 
corplote  preliminary  design  of  a training  plane.  As  ny  work  in 
design  progressed,  I started  to  becone  aware  of  the  tremendous 
limitations  facing  an  aircraft  designer:  there  were  deadlines  to 
be  met  and  designs  to  be  ccnpleted  while  arploying  very  inconplete 
informatics.  Early  in  the  game  (I  was  then  only  25  years  old) , I 
decided  that  I did  not  like  this  state  of  affairs.  i decided  that 
incdiplete  informticai  we^s  unappealing  to  me  and  that,  by  terpera- 
ment,  I required  more  coiplete  infontation.  I felt  that,  in  order 
to  beocme  a really  good  aircraft  designer,  a knowledge  of  advanced 
research  techniques  was  neoessary.  With  this  in  mind,  I undertook 
a fateful  (only  for  Miele,  not  for  the  rest  of  the  world)  and 
irreversible  step  toward  basic  reseeuxh  in  aerospace  engineering. 

4.0  EnqtneeArwg  RaAeoick.  first  love  was  flight  mechanics. 

In  1947-48,  the  problems  of  the  meclianics  of  flight  of  turbojet- 
powered  vehicles  were  all  inportant,  and  I devoted  considerable 
time  to  the  study  in  d^)th  of  flight  trajectories.  Within  the 
clciss  of  feasible  flight  trajectories,  the  study  of  the  optinum 
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flight  trajectories  is  of  particular  iitpDrtance,  and  this  in  turn 
leads  to  irathenatical  problems  viiich  belong  to  the  realm  of  the 
calculus  of  variations  and/or  optimal  control. 

In  1952,  the  great  and  late  Antonio  Ferri  offered  me  to  join 
his  research  group  at  the  Polytechnic  Institute  of  Brooklyn.  I 
accepted  with  enthusiasn  and  I worked  with  him  for  three  years  at 
the  aerodynamic  design  of  seme  of  the  hyperseme  wind  tunnels  of 
the  Polytechnic  Institute  of  Brooklyn. 

In  1955,  I joined  the  staff  of  Purdue  University,  and  returned 
to  my  first  love  (mechanics  of  flight) , with  a new  twist:  the 
study  of  the  cptimiin  trajectories  of  rocket-powered  vehicles.  I 
was  fortunate  enought  to  convince  both  APOSR  and  NASA  to  back  ny 
work  on  optimum  flight  trajectories.  In  particular,  I started  a 
long  and  rewarding  association  with  APDSR. 

In  1959,  I joined  the  staff  of  the  Boeing  Scientific  Research 
Laboratories  and  continued  ny  work  on  optimum  flight  trajectories. 
This  work  culminated  in  the  book  Flight  Mechanics  (Addisen-Wesley, 
1962) . In  addition,  I became  interested  in  tlie  theory  of  optimum 
aerodynamic  shapes.  Together  with  ity  research  group  at  BSRL,  I 
tackled  a wide  variety  of  eptimizatien  prcblems  occurring  in  the 
aerodynamics  of  supersonic,  hypersonic,  and  free-molecular  flews. 
Mathematically  speaking,  these  problans  also  belong  to  the  realm 
of  the  calculus  of  variatic»is  and/or  optimal  ocaitrol. 

In  1964,  I decided  that  it  was  time  to  return  to  university 
teaching  and  research.  The  conbinaticn  of  Houston  with  Rice  Univ- 
ersity proved  to  be  particularly  attractive,  also  in  view  of  the 
fact  that  the  NASA-Johnson  Space  Center  is  located  in  Houston.  At 
Rice  University,  I continued  aggressively  my  work  on  cptimum  aero- 
dynamic shapes  under  the  sponsorship  of  APCSR  and  NASA-Langley 
Ftesearch  Center.  This  work  culminated  in  the  edited  book  Theory 
of  Cptimum  Aerodynamic  Shapes  (Academic  Press,  1965) . 
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5.0  App^xed  UaXhmcLtici  ReACflAch.  Atcut  10  years  ago,  viiile 
inorking  on  the  problan  of  optimizing  vangs,  fuselages,  and  wing- 
fuselage  cxmbinations  under  different  flew  regimes,  our  research 
program  reached  a point  vAiere  advances  became  increasingly  diffi- 
cult. feeling  was  that  we  were  in  the  presence  of  a rather 
steep  Vvall  and  that  a tremendous  amount  of  analytical  ingenuity 
was  required  in  order  to  make  relatively  small  advances.  Perhaps, 
the  best  way  to  portray  the  situation  is  this:  I felt  like  a man 
vto  is  trying  to  walk  on  broken  glass  without  shoes. 

The  reason  for  the  changed  situation  was  the  followi'ig.  We 
had  almost  exhausted  our  bag  of  analytical  tricks,  and  we  were 
facing  nimerical  difficulties  of  ever  increasing  ccrplexity. 

When  I sensed  that  this  was  the  case,  I said  to  myself:  Angelo, 
you  can  no  longer  be  a first-rate  engineer  without  a full  and 
total  knowledge  of  numerical  methods.  With  this  in  mind,  I under- 
took another  fateful  (again,  only  for  Miele,  not  for  the  rest  of 
the  world)  and  perhaps  irreversible  step  toward  basic  research  in 
numerical  methods  and  computing  techniques. 

Since  I felt  that  to  work  simultaneously  on  engineering 
research  and  mathematical  research  was  rather  inefficient  (any 
good  general  would  understand  that) , I dunped  overnight  all  of 
engineering  problems  and  started  to  work  at  full  blast  on  mathe- 
matical problans  only.  My  intentirai  was  to  gain  rapid  knowledge 
of  numerical  techniques,  in  order  to  be  able  to  return  to  engi- 
neering at  a later  time  and  then  tackle  more  complex  problems. 

In  the  meanwiiile,  Mr.  R.  L.  Pritclard,  formerly  of  the  Boeing 
Cerpany,  had  joined  my  grotp  at  Rice  University.  Together  with 
him,  I undertook  a review  of  previous  work  in  the  area  of  algori- 
thms for  optimal  control  theory.  As  soon  as  we  started  this 
review,  we  realized  that  we  faced  two  severe  limitations.  First, 
the  work  of  seme  of  the  leading  authorities  on  the  subject  was  not 
exactly  a masterpiece  of  clarity.  Seccsid,  there  were  seme  huge 
holes  in  tlie  existing  body  of  knowledge;  and  there  were  unanswered 
questions  all  over  the  place. 


In  the  light  of  this  situation,  we  decided  early  in  ths  game  i 

that  we  should  develop  our  own  independent  research  program,  lead-  j 

ing  to  new  algoritlms  for  solving  all  sorts  of  problems  of  applied  | 

mathematics  on  a digital  ccrputer.  Since  I oould  bank  on  ity  pre-  1 

vious  reputation  in  engineering  research,  it  was  not  difficult  for  ■ 

me  to  persuade  AFOSR,  NASA,  and  later  on  NSF  to  back  the  work  of 

the  Aero-Astronautics  Group  of  Rice  University  in  the  area  of  | 

numerical  methods.  ! 

As  soon  as  our  program  on  algorithms  for  optimal  control  1 

theory  had  started,  I realized  that  the  solution  of  cptimal  con-  i 

trol  problems  on  a digital  ccnputer  cannot  be  divorced  from  the  i 

solutiOTi  of  differential  equations.  That  being  the  case,  we 
started  a second  program  dealing  with  the  numerical  soluticxi  of 

tvro-point  and  multi-point  boundary-value  problems  on  a digital  j 

ccjiputer.  j 

For  several  years,  the  ccnputing  center  of  Rice  University 
had  been  equipped  with  a Burroughs  5500  ccnputer;  more  recently, 
it  has  been  equipped  with  an  IBM  370/155  ccrputer.  In  spite  of 
the  ccnsiderable  capabilities  of  these  ccrputers,  we  found  that 
scms  optimal  ccxitrol  problan  could  tax  the  memory  of  these 
ccrputers  almost  to  the  limit.  Vfe  also  found  that  seme  optimal 
control  prctolan  could  be  quite  expensive  on  a digital  ccnputer. 

Since  cur  funds  were  relatively  limited,  it  seemed  difficult  for 
us  to  be  able  to  develop  in  this  way  the  type  of  systematic  info- 
rmatics viiiich  is  needed  in  order  to  give  algoritlms  for  cptiital 
control  theory  their  most  useful  stnKrt:ure. 

To  offset  the  above  difficulty,  I reasoned  as  follows.  For 
every  problem  of  cptimal  control,  there  must  be  a counterpart  in  '■ 

mtheratical  prograitming  vAiich  is  easier  to  solve:  it  does  not  i 

test  the  memory  capabilities  of  a given  ccnputer,  and  it  does  not 
require  as  much  ccnputer  time.  In  this  spirit,  we  started  a third 
program  leading  to  the  develcproent  of  ccnputer  algoritlms  for 
mthematical  progranming  problems. 
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Just  as  the  solution  of  cptimal  ccaitrol  prctolems  is  related 
to  the  solution  of  differential  equations,  the  solution  of  irathe- 
matical  prograitming  problatis  is  related  to  the  solution  of  non- 
differential equations  (namely,  algebraic  and  transcendental 
equations).  As  a consequence,  it  was  natural  for  us  to  start  a 
fourth  program  dealing  with  the  nimerical  solution  of  nondifferen- 
tial equatic*is. 

In  sonnary,  after  a few  short  years,  our  research  program  on 
ccnputing  methods  lad  grown  to  a considerable  size.  Indeed,  it 
included  calculus  of  variations,  optimal  control,  differential 
equations,  tvo-point  and  multi-point  boundary-value  problems, 
mathematical  programming,  and  solution  of  nondifferential  equa- 
tions. Several  people  have  contributed  in  a substantial  way  to 
this  program.  While  the  list  is  a long  one,  I would  like  to 
mention  Professor  H.  Y.  Huang  (presently  with  EPRA,  Exxon  Produc- 
ticn  Research  Ccmpany,  Houstcn,  Texas)  and  Dr.  A.  V.  Levy  (pre- 
sently with  CIMAS,  Corputing  Center  of  the  University  of  Mexico, 
Mexico  City,  Mexico) . 

6.0  Thoaghti  on  ALgofuXhm  V&veXoprmnt  and  Uiagz.  In  Section  5, 

I discussed  the  natural  develcpment  of  our  research  program  on 
cdiputing  methods.  In  this  secticai,  I shall  describe  seme  of  the 
p^losophical  thoughts  that  helped  shying  our  program. 

(a)  First  of  all,  the  nature  of  a digital  cerputer  is  such 
that  the  use  of  vectors  and  matrices  is  beneficial  to  problan 
formulation.  On  a digital  cemputer,  a problem  of  flight  mechanics 
is  no  different  from  a problem  of  chsnical  engineering,  as  long  as 
both  problems  are  described  by  the  same  kind  of  vector  differential 
equation  and  vector  boundary  conditions,  for  exanple. 


X - f(x,t)  = 0, 

0 

1 A 

til. 

(1) 

g(x,t)  = 0 

at 

t = 0, 

(2) 

h(x,t)  = 0 

at 

t = 1, 

(3) 

viAiere  f,g,h  are  vector  functions  of  appropriate  dimensions. 

This  concept  helps  grotping  seme  apparently  different  prob- 
lems into  broad  classes  of  problems,  such  that  a caution  algorithn 
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can  be  developed  for  solving  every  problem  belcxiging  to  the  same 
class.  The  fact  that  a particular  prcfclem  deals  with  flight 
mechanics  and  another  particxiLar  problem  deals  with  chemical 
engineering  comes  into  play  only  a posteriori,  after  an  algorithm 
has  been  developed,  through  different  specialization  of  the  func- 
tions f,g,h  and  their  derivatives. 

If  the  above  point  of  view  is  taken,  then  one  can  develop 
algorithms  useful  for  a wide  variety  of  problans  of  the  real  world, 
even  though  the  primary  interest  of  a particular  scientist  might 
be  just  flight  mechanics.  Indeed,  by  giving  generality  to  prob- 
lem formulation,  one  can  succeed  in  developing  algorithms  not 
only  useful  in  aerospace  engineering,  but  also  simultaneously 
useful  in  other  areas  of  engineering,  science,  and  economics. 

(b)  In  line  with  (a) , it  is  sitiply  uneconomical  and  ineffi- 
cient to  try  to  develop  a new  mathematical  algorithm  every  time 
one  faces  a new  technical  problati.  Usually,  it  is  more  ecca-icmical 
and  efficient  to  try  to  enploy  transformation  techniques  such  that 
a problem  A belonging  to  a given  class,  for  vdiich  algorithms  are 
not  available,  is  converted  into  a problem  B belonging  to  another 
class,  for  vbich  algorithms  are  already  available. 

Of  course,  transformation  techniques  have  their  own  limita- 
tions. They  can  be  used  providing  the  structure  of  problem  B is 
not  too  different  from  thie  structure  of  problem  A.  With  these 
limitations  in  mind,  judicious  use  of  transfomation  techniques 
can  be  helpful  in  limiting  to  a considerable  degree  the  prolifera- 
tion of  algorithms  solving  similar  and/or  related  problems. 

(c)  The  successful  develcpment  of  algorithms  for  digital 
ccrputer  usage  is  partly  a science  and  partly  an  art.  Conputer 
experimentation  plays  a fundamental  role,  since  thiis  is  thie  only 
way  to  uiKiover  possible  weaknesses  and  correct  th»ese  weaknesses 

if  they  exist.  Only  in  thiis  way  ccin  one  hicpe  to  develop  algorithms 
that  are  robust,  thiat  is,  capable  of  leading  to  the  solution  of 
many  different  problems  under  a wide  veuriety  of  operating  condi- 
tions. 
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(d)  As  a c»rollary  to  the  above  thought,  it  is  radier  unlike-  I 

ly  that  a successful  algorithm  might  be  developed  by  sane  mad  |j 

scientist,  who  gets  up  on  a given  morning  on  the  right  side  of  the  i. 

bed.  It  is  nice  to  dream  of  sene  genius  vho  had  a wild  idea  that 

just  happened  to  work  without  a hitch  on  a digital  cenputer.  But  | 

frankly,  this  is  not  the  standard  situation;  and  this  is  because  ! 

a digital  coiputer  has  its  own  rules  of  operations  and  its  own 
internal  logic;  and  vhile  this  logic  is  limited,  it  is  usually 
more  consistent  than  our  own  human  logic. 

(e)  P scientist  has  the  duty  to  test  his  theories  experimen- 
tally, in  order  to  understand  its  limitations  and  try  to  offset 
these  limitatiens,  if  at  cill  possible.  If  this  is  not  possible, 
then  a scientist  has  the  duty  to  state  these  limitations  clearly, 

so  that  they  can  be  corrected  through  subsequent  work  of  the  same  j 

groip  of  people  or  some  other  group  of  people. 

(f)  Frank  exchange  of  information,  collaboration,  and  inter- 
action between  scientists  belonging  to  the  same  group  is  fundamen- 
tal in  order  to  succeed  in  algorithti  research  and  development.  It 
is  most  inportart  that  both  information  relative  to  failures  and 
information  relative  to  successes  be  conveyed  prcrptly  to  every 
element  in  a group.  Indeed,  negative  information  can  be  as  inpor- 
tant  as  positive  information  in  shaping  the  Icxig-range  goals  of  a 
grexp  and  in  determining  the  most  efficient  distributicai  of  tasks 
within  a given  groip. 

(g)  When  applying  optimization  algorithr>s  to  the  solution  of 
engineering  problems,  it  must  be  remembered  that  nothing  catastro- 
phic usually  happens,  from  the  point  of  view  of  the  performance 
index,  if  an  exact  optiimm  is  replaced  by  an  approximate  optimum. 

This  is  the  same  as  saying  that,  in  the  real  world,  satisfaction  t' 

of  the  feasibility  equations  is  usually  more  important  than  satis- 
faction of  the  optimality  conditions. 

Paradoxically,  it  might  seem  that  I am  stating  that  optimiza-  | 

tion  is  less  important  than  we  like  to  think,  and  this  thought 
might  shock  some  professional  optimizers.  But,  if  one  recovers 
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from  the  shock,  then  one  can  take  advantage  of  this  thought  when 
selecting  the  algorithm  to  be  atployed  in  the  solution  of  a given 
engineering  problem  and  when  choosing  the  so-called  stewing  con- 
ditions for  the  feasibility  equations  and  the  optimality  condi- 
tions. 

By  adhering  to  the  point  of  view  expressed  under  points  (a) 
through  (g) , the  Aero-Astronautics  Groi^  of  Rice  University  has 
succeeded  in  developing  a wide  variety  of  robust  algorithms  use- 
ful for  all  sorts  of  problems  of  af^lied  mathematics.  Perhaps, 
the  best  measure  of  this  success  is  the  fact  that  our  groi^  has 
received  over  the  years  seme  5000  requests  for  the  various  reports 
and  papers  that  suitmarize  the  results  of  our  research  program. 

Does  this  mean  that  the  proof  of  the  piidding  lies  in  the  eating? 
7.0  A Vlaui  o(f  the  Fotirie.  klZoc.aX.Lon  o/j  Fundi.  Even  though  the 
digital  cemputer  is  barely  20-25  years  old,  considerable  advances 
have  been  achieved  thus  far  in  the  science  and  art  of  cenputing. 

It  appears  probable  that  these  advances  will  continue  without  any 
substantial  slackening  over  the  next  25-30  years.  It  also  appears 
probable  Uiat,  by  the  beginning  of  the  next  century,  a relative 
steQj  vail  might  be  reached.  Beyond  that  time,  progresses  might 
become  slower  and  more  painful  to  achieve. 

Since  the  next  25-30  years  appear  to  be  crucial  to  the  devel- 
opment of  new  and  more  sophisticated  cotputing  techniques,  the 
follcwing  questions  arise:  (i)  Should  allocations  for  research  in 
coiputing  methods  be  increased?  (ii)  What  is  the  proper  level  of 
support? 

In  approaching  the  above  questions,  the  preper  reasoning  is 
as  follows.  Basic  research  in  numerical  methods  and  cerputing 
techniqxjes  transcends  in  irrportance  basic  research  in  every  other 
area  of  engineering,  science,  and  econcmics,  for  a simple  reason. 
Real-world  problans  of  aerospace  engineering,  electrical  engineer- 
ing, mechanical  engineering,  and  so  on,  ultimately  require  that 
seme  set  of  equations  and/or  inequalities  be  solved  on  a digital 
cenputer.  Therefore,  to  acquire  a capability  in  nimerical  methods 
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and  cjonputing  techniques  implies  to  acquire  an  enhanced  capability 
in  engineering,  science,  and  economics. 

In  the  light  of  the  above  reasoning,  it  ap^aears  that  the 
answer  to  question  (i)  is  decisively  affintative.  Concerning 
question  (ii) , one  must  ranani  or  that  research  in  coiputing  meth- 
ods is  relatively  inexpensive  and  occi^iies  at  this  moment  only  a 
tiny  fracticn  of  the  overall  budget  of  najor  govemnent  agencies, 
such  as  APOSR,  ARD,  CNR,  and  NSF.  Thus,  it  is  entirely  appropri- 
ate for  the  tcp  management  of  the  military  as  well  as  for  the  top 
management  of  NSF  to  consider  doubling  or  tripling  the  funds  pre- 
sently allocated  for  ccrputing  research. 

S.O  V-iitA-ibiiCcon  FuncU.  In  this  section,  I shall  touch  a very 
sensitive  topic,  that  of  the  distribution  of  research  funds  within 
the  nation.  The  standard  operating  procedure  of  government  agen- 
cies seems  to  be  more  or  less  as  follows.  Siqpose  that  government 
agency  XYZ  has  a yearly  budget  of  2000K.  Furthermore,  suppose  that 
I we  divide  this  budget  into  100  equal  packages,  each  worth  20K. 

j Then,  it  follows  that  govemnent  agency  XYZ  can  support  100  prin- 

I cipal  investigators,  spread  more  or  less  with  uniform  density  all 

i over  the  country.^ 

t In  proceeding  along  the  above  lines,  government  agency  XYZ 

I avoids  political  critician.  At  the  same  time,  it  buys  technical 

■ insurance:  if  agency  XYZ  supports  100  efforts,  even  admitting 

I that  only  20%  of  these  efforts  turn  out  to  be  good,  then  agency 

XYZ  is  actually  supporting  20  good  research  programs. 

The  draviack  of  the  above  operating  procedure  is  tliat  it  is 
in  direct  conflict  wdth  two  basic  ccocepts  of  the  real  world: 

(i)  even  though  the  USA  is  the  richest  nation  in  the  world,  its 
financial  means  are  limited:  and  (ii)  in  any  given  area  of 
research,  the  svpply  of  true  talent  is  also  quite  limited. 


^ In  the  C^-language  (C^  meaning  ccaitracts) , it  is  kncwn  that 
IK  = $1000. 
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Because  of  the  realities  of  (i)  and  (ii) , one  must  wraxier 
vAiether  a more  efficient  use  of  national  resources  can  be  achieved 
through  concentration  of  effort,  that  is,  through  the  allocation 
of  larger  grants  into  more  capable  hands.  In  svggesting  this 
course  of  action,  I feel  that  sane  iitmediate  clarification  is 
necessary.  I am  not  really  thinking  about  semipolitical  handouts 
of  tlie  Themis  type.  I am  rather  thinking  atxaut  cillocation  of 
larger  chunks  of  research  funds  into  the  hands  of  the  best  avail- 
able technical  talent. 

Now,  I am  fully  aware  of  the  fact  that  allocation  of  research 
funds  solely  on  the  basis  of  technical  considerations  might  cause 
a national  outcry:  I can  envision  scores  of  senators  and  congress- 
men firing  telegrams  all  over  the  place,  because  their  pet  univ- 
ersity did  not  get  the  proper  share  of  the  research  pie. 

In  the  light  of  the  above  possibility,  it  might  be  that  the 
best  course  of  actic»i  is  a oompronise  betveen  national  needs  and 
local  needs.  As  the  Ronans  used  to  say,  in  medio  stat  virtus. 

For  exanple,  consider  once  more  the  budget  of  government  agency 
XYZ  (2000K) , and  sifljpose  that  this  budget  is  split  into  two  equal 
parts:  lOOOK  devoted  to  the  suj^xart  of  snail  efforts  (each  worth 
20K)  and  lOOOK  devoted  to  the  support  of  large  efforts  (each 
worth  100  K) . If  this  course  of  action  is  taken,  then  govemtent 
agency  XYZ  might  be  su^xorting  50  small  research  efforts  plus  10 
large  research  efforts.  In  this  way,  political  criticism  might 
still  be  avoided;  technical  insurance  might  still  be  bought.  Yet, 
the  realities  of  the  financial  situation  of  the  country  and  of  the 
nature  of  basic  research  might  be  more  adequately  considered  than 
ever  before. 

9.0  Laq/mnge  and  NapoZzon.  During  the  first  day  of  this  meeting. 
General  Welch  mentioned  a particular  technical  prcdolem  in  viiich 
lagrange  multipliers  played  a role.  I would  like  to  inform  General 
Welch  that  I have  been  dealing  with  lagrange  multipliers  for  the 
past  30  years.  At  Rice  University,  we  have  developed  all  sorts  of 
algorithms,  even  algorithms  capable  of  optimizing  thie  distribution 
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of  Lagrange  multipliers  withing  a system  governed  by  equations 
and  or  inequalities.  Also,  we  have  optimized  the  distribution  of 
Lagrange  multipliers  for  systems  described  by  differential  equa- 
tions and  appropriate  boundary  conditions. 

The  name  Lagrange  is  of  such  comnon  usage  in  today's  tech- 
nical vrorld  that  a catment  is  in  order.  Contrary  to  superficial 
appearance,  Lagrange  was  neither  a French  nor  a Louisiana  Cajun. 

He  was  an  Italian,  bom  in  Turin  in  the  year  1736.  Indeed,  his 
certificate  of  birth  bears  the  name  of  Giuseppe  lodovico  Lagrangia. 
He  taught  ballistics  at  the  Military  Acadeny  of  Artillery  in  Turin 
and  founded  the  Acadeny  of  Sciences  of  Turin,  a dusty  academy  that 
still  exists  today.  By  the  way,  I was  just  elected  a Correspond- 
ing ffember  of  that  venerable  academy. 

At  the  age  of  30,  lagrangia  (already  famous  for  his  work  on 
Analysis,  Algebra,  Calculus  of  Variations,  and  Analytical  Mechan- 
ics) left  Turin,  first  for  Germany  (vtere  he  spent  21  years)  and 
then  for  France  (vAiere  he  spent  the  last  26  years  of  his  life) . 

In  France,  he  changed  the  spelling  of  his  name  to  Lagrange,  and 
this  explains  viiy  we  talk  today  abcut  Lagrange  multipliers  rather 
than  Lagrangia  multipliers. 

But  lagrange  was  not  the  only  Italian  who  becane  prardnent  in 
the  French-sp)eaking  world.  Since  this  is  a meeting  of  generals,  I 
vrould  like  to  mention  the  name  of  the  greatest  general  of  all  times, 
Napxoleone  Bonaparte,  viho  was  bom  in  Aiaccio,  Corsica,  from  an 
Italian  family. 

It  is  not  ironic  that  the  two  greatest  Frenclmen  that  ever 
lived,  Lagrange  and  Napoleon,  both  happened  to  be  Italians? 

10.0  Concluding  Rema/tfe/6.  I have  done  my  taest  to  give  everybody 
in  this  audience  an  idea  about  the  nature  of  the  work  of  the  Aero- 
Astronautics  Groip)  of  Rice  University  in  engineering  eind  applied 
mathematics.  I have  described  seme  of  the  philosophical  thoughts 
guiding  our  work  in  numerical  analysis  and  cemputing  methods. 

I realize  that  our  academic  work  has  Ljeceme  so  technical 
that,  quite  often,  pjeople  in  government  agencies  are  at  a loss  in 
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understanding  the  inplications  of  this  work.  This  leads  to  the 
gap  that  I have  described  at  the  beginning  of  my  talk. 

To  bridge  this  gap,  it  would  be  a good  idea  that  government 
personnel  (in  particular,  AF  personnel)  be  sent  to  work  with 
senior  scientific  personnel,  working  in  the  universities,  for  a 
period  of  one-two  years.  In  this  sense,  I support  the  recoimen- 
dations  provided  by  Professor  r.  e.  Kalaba  in  the  opening  lecture 
of  this  session. 

Concerning  the  relation  of  nv  work  with  C^-situations  and 

C^-situations,  I cannot  tell  for  sure  whether  a connection  eodsts. 

But  I can  think  of  two  prdoleJtB  to  which  my  work  aj^lies  and  which 

should  be  inportant  to  the  top  management  of  the  military:  weapons 

allocaticn  problems  and  interception  problems.  At  any  rate,  while 

2 

I am  not  sure  of  the  relevance  of  my  work  to  C and  C , I am 

quite  sure  of  its  relevance  to  AE,  ND,  and  USA. 

New,  suppose  that  there  is  semebody  in  this  audience  vrfoo  is 

still  not  satisfied  with  my  statements  and  says:  "Dr.  Miele,  I 

like  your  speech,  but  I still  do  not  understaiod  the  relation  of 
2 3 

your  work  with  C and  C ".  Then,  my  ansv«r  would  be  ..ore  or 
less  as  follows:  "Mr.  so  and  so,  I believe  that  your  question  is 
very  perceptive  and  stimulating.  But  I am  unable  to  sipply  a 

clear-cut  answer,  for  reasons  of  national  security.  Specifically, 

2 

in  onler  to  expound  about  the  relations  of  my  work  with  C and 

C^,  I would  have  first  to  expound  about  the  relations  of  my  work 
4 5 

with  C and  C . And  this  I cannot  do,  because  it  is  militarily 
classified  information" . 
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A COMMENT  ON  THE  ESTIMKriON  OF  PRCBABILITY  DENSITY  UNCTIONS 


by  G.  L.  WISE 

Un.<veAiCtij  0(5  Texa6  at  Amtui 


Decision  theory  and  general  statistical  models  are  currently 
being  applied  in  many  military  settings.  For  exanple,  consider 
the  situaticxi  in  which  it  is  desired  to  discriminate  between 
vAiales  and  submarines.  Or,  as  another  exanple,  consider  the  situ- 
ation in  which  it  is  desired  to  detect  the  presence  of  an  aircraft. 
These  and  other  similar  situations  can  be  modeled  as  hypothesis 
testing  problems. 

In  a vast  nimber  of  decision  theoretic  models,  there  is  the 
assumption  of  a probability  density  function  which  characterizes 
the  distribution  of  the  ctoserved  quantities.  The  resulting  hypo- 
thesis test  is  then  structured  i;^n  the  assuned  probability  den- 
sity functions.  By  and  large,  probability  densities  are  not 
obtained  fron  physical  derivaticsis,  but  fron  enperical  data. 

Measurements  are  taken,  and  fron  these  measurements  a density 
function  is  obtained.  Several  methods  have  been  proposed  for  the 
estimation  of  probability  density  functions,  and  nutterous  proper- 
ties of  these  methods  have  been  studied  [ 1 ] . Perhaps  the  most 
ccnmon  method  is  that  which  is  based  upon  the  "kernel  approeich"  to 
the  estimation  of  probability  density  functions.  However,  these 
methods  assune  that  the  measuranents  fron  which  the  density  is 
estimated  cure  not  corrupted  by  noise. 

In  many  practical  situations,  the  measurarents  fron  v^ich  one 
constructs  the  estimated  density  are  corrupted  by  noise.  The 
corrupting  noise  might  arise  frcm  background  noise  not  associated 
with  the  random  variable  of  interest,  or  it  may  arise  from  noise 
introduced  by  the  measuring  techniques.  The  author  is  currently 
investigating  the  (nonparametric)  estimation  of  a probability 
density  function  frcm  noisy  measuranents.  Several  classes  of  noise 
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distributions  are  being  considered.  Tte  method  is  based  upon  the 
"kernel  approach"  to  estimation  of  prchability  density  functions 
introduced  by  Parzen.  His  basic  technique  is  modified  with  a type 
of  de-convolution  operation.  The  goal  is  the  design  of  practical 
(i.e.  easily  implementable)  estimators  vdiich  are  asynptotically 
unbiased  and  consistent  in  the  quadratic  mean.  Although  there  is 
a quite  extensive  literature  on  the  estimation  of  probability 
density  function  (most  of  it  relatively  new) , little  has  been  done 
for  the  case  vdiere  the  mgasuranents  are  corrupted  by  noise. 

This  work  is  si.5^rted  by  the  Air  Force  Office  of  Scientific 
Research,  Air  Force  Systems  Cotmand,  USAF,  under  Grant  AFOSR-76- 
3062. 
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HUMAN  PROCESSES  IN  BATTLEFIELD  INFORMATION  SYSTEMS 

by  Robert  S.  Andrews 
U.S.  Aimij  ReieoAcIi  Imtctuta 


The  vehicles  for  decision  information  for  tactical  cairand 
and  control  from  an  Army  perspective  are  often  identified  as 
battlefield  information  systems.  For  the  forseeable  future,  human 
processes  will  be  an  integral  part  of  such  systems  and  mast  be 
attended  to  as  explicitly  as  the  coiputer  technology  if  signifi- 
cant advances  in  system  capability  are  to  be  achieved.  This  coti- 
cept  and  its  iitplications  will  be  developed  in  subsequent  sections 
of  this  paper.  We  will  begin  with  an  attaipt  to  define  the  Army 
problem  and  then  consider  in  sequence  vhat  are  seme  of  the  relevant 
variables,  how  their  effects  might  be  measured,  whether  solutions 
are  intuitively  (±>vious,  and  some  of  the  premises  to  be  realized 
and  pitfalls  to  be  avoided  as  we  look  towards  advanced  coiputer 
tecdmology  to  provide  solutions. 

!.0  Scoping  the  Anmii  P^obim.  A convenient  point  of  departure 
for  looking  at  Army  concerns  within  the  workshop  thane  of  "deci- 
sion information  for  tactical  cemand  and  control"  is  to  provide 
an  eperatiemal  definition  or  statement  of  the  goals  or  objectives 
of  cemand  and  control.  Siitply  stated  cemand  and  control  is  the 
planning,  directicxi,  coordination  and  control  of  operational 
activities  of  forces  in  a manner  most  likely  to  result  in  the 
achievement  of  friendly  c±ijectives  and  the  denial  of  coipeting 
objectives  to  the  enany.  Requisite  for  effectiveness  in  this 
domain  is  the  availability  of  required  information  in  a suitable 
form,  on  a timely  basis,  appropriately  digested  and  synthesized  to 
enable  the  best  decision,  monitoring  the  execution  of  the  decision, 
and  reacting  ad  hoc  to  unexpected  happenings  in  the  subsequent 
unfolding  events.  It  is  clear  that  this  is  no  anall  order  given 
the  tanpo  of  modem  wearfare  and  the  diversity  of  kinds,  enormity 
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of  amounts  and  sources  of  informatics  and  means  to  aoquire  same. 
It  is  also  relevant  to  note  in  this  context  that  an  Army  division 
is  by  no  means  anall  business  either  in  terms  of  capital  invest- 
ment, recurring  costs  or  numbers  of  personnel  "enployed".  It  can 
be  seen  in  Table  1 that  the  initial  fielding  costs  af^iroach  $2 
billion  for  an  armored  division  and  only  about  $200  million  less 
for  a mechanized  infantry  division.  This  translates  into  roughly 
10  to  12  billion  doUcurs  for  a Corps  and  more  than  one-quarter 
million  personnel. 

Table  1.  Approximate  Magnitude  of  Resources  "Cottnanded"  and 
"Controlled"  by  an  Amy  Division  and  Corps 

FORCE  COSTS  (WAR  CONDITIONS 


INITIAL 

FIETDING 

COST 

ANNUAL 

RECUR 

COST 

OFF 

STRENGTH 

EIILISrED 

STRENGTH 

TOTAL 

PERSCNNEL 

CORPS 

APPROX  5, 

.5  X DIV 

MEX31  INF  DIV 
(FORCE  BQUIV) 

1.699  BIL 

796  MIL 

3,979 

42,008 

45,987 

ARMORED  DIV 
(FORCE  BC3UIV) 

1.878  BIL 

840  MIL 

4,173 

43,557 

47,730 

Achieving  a caimand  and  control  capability  to  cc^  with  the 
highly  ccrplex  dynamics  of  future  battlefield  situations  is  a high 
priority  need.  Satisfaction  of  this  need  must  focus  on  affordable 
alternatives  vrfiich  c^italize  on  the  respective  strengths  of  man 
and  cdiputer  and  ccmpensate  for  their  respective  weaknesses.  An 
initial  step  in  such  a procedure  is  to  determine  vrfiat  variables 
are  relevant. 

2 . 0 Some  Relevant  V(VUja.bZu . The  effectiveness  of  most  any  sys- 
tan  can  be  attributed  to  three  major  factors  vhich  are  at  one  and 
the  sate  time  both  independent  and  interdependent  to  varying 
degrees  depending  on  the  purpose  the  system  is  intended  to  satisfy. 
This  can  be  expressed  analytically  as: 

E = F(S,  P,  D) 
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v^ere  E = potential  battlefield  effectiveness  as  a function 
of: 

S = Systan  design  capability 

P = Proficiency  of  operators  and  users  of  the  system 

D = Doctrine  for  aiploying/utilizing  the  systan 
The  distinction  among  these  factors  is  particularly  inportant  when 
it  comes  to  considerations  of  designing  a system  around  human 
limitations  i.e.  there  is  no  point  in  providing  a sophisticated 
system  capability  the  utilization  of  vhich  is  dependent  ipon  a 
skill  level  vhich  doesn't  exist  or  can't  be  trained  into  the 
expected  user.  Conversely  it  is  not  efficient  to  provide  for 
extensive  user  training  for  executing  functions  vdiich  could  easily 
be  acccrmodated  in  systan  design  capability.  There  are  many  trade- 
offs Vihich  can  be  made  in  this  danain.  Failure  to  perform  the 
research  necessary  to  sipport  these  determinations  is  likely  to 
result  in  overdesigned  or  underdesigned  hardware,  over  trained  or 
under  trained  users  and  unutilized  or  inefficiently  utilized  sys- 
tems. 

There  are  many  variables  or  issues  vhich  impact  on  the  prin- 
ciple factors  and  related  tradeoffs  associated  with  battlefield 
information  systans.  A number  of  the  more  significant  ones  vhich 
clearly  involve  human  processes  and  performance  are  identified 
and  their  implications  briefly  described  below: 

1.  Volume  of  information.  The  amount  of  information  poten- 
tially available  is  so  enormous  that  it  nay  well  irrpede  rather 
than  aid  unless  effective  means  can  be  developed  to  screen  out 
irrelevant,  redundant  informatics;  codify  and  catalog  for  ready 
accessibility;  aggregate  and  integrate  for  data  base  econcmy  and 
understanding;  identify  and  purge  that  data  which  is  of  least 
current  and  projected  value. 

2.  Quality  of  information.  The  quality  is  highly  variable 
as  a function  of  the  source,  inherent  situaticsal  uncertainties, 
coding,  transformation  and  inputting  errors.  Ways  must  be  found 
to  minimize  occurrence  of  errors,  detect  errors  when  they  do  occur. 
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ard  accurately  assess  and  cominicate  the  protable  accuracy  of  the 
information. 

3.  Value  of  information.  Worth  is  variable  as  a function  of 
echelon,  mission  and  timeliness  as  well  as  quality  characteristics. 
Ways  must  be  fourd  for  realistically  assessing  the  ejqjected  value 
of  information,  and  establishing  processing  and  acquisition  prior- 
ities in  accordance  with  the  value  structure. 

4.  Manipulation  of  information.  In  a problem  solving  sense 
data  nanipulation  is  essential  if  our  capability  is  to  be  more 
tJian  a file  cabinet  and  message  switching  operation  coupled  to  a 
user' s unaided  decision  process,  ^ten's  capability  must  be  extended 
with  itcdels,  algorithms,  logic  structures,  etc.,  to  enable  him  to 
more  quickly,  thoroughly  and  accurately  consider,  evaluate  and 
interpret  the  masses  of  information  and  myriad  ccrrplexities 
involved  in  various  alternative  actions. 

5.  Form  of  information  presentation.  Form  is  key  to  effi- 
cient understandir^,  assimilation  and  utilization  of  information. 
Not  enough  is  known  abcut  the  perceptual-cognitive  domain, 
symbolic  representation  and  differentiation,  sensory  overload, 
etc.,  as  a function  of  information  characteristics  and  intended 
use  bo  enable  sound  decisions  regeirding  questions  of  presentation 
media,  sensory  modality,  graphic  vs.  alpha-numerics,  black  and 
white  vs.  color,  shape  vs.  size,  etc.,  in  general.  Cultured,  and 
task  differences  need  also  be  addressed. 

6.  Comunication  of  information.  Comunication  is  a sine 
qua  non  of  effective  information  systems  and  is  the  single  veir- 
ible  having  the  greatest  discrepancy  between  the  actual  severity 
of  the  problem  and  the  acknowledged  severity.  It  enccirpasses  maiV 
man,  mar\/machine,  and  machine/taachine  (interoperability)  exchanges 
It  relates  to  the  penennial  problan  wherein  tte  exchange  of  words, 
shapes,  sentences,  codes,  etc. , is  not  accoipanied  by  an  exchai^e 
in  the  intended  mecining. 
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7.  Factors  underlying  caimand  team  effectiveness.  Most 
ooitmand  and  control  research  and  training  vehicles  now  focus  on 
the  procedural  aspects  of  the  tasks  to  the  neglect  of  factors  less 
readily  defined.  Research  is  required  to  identify  the  less  obvi- 
ous variables  that  are  reliably  related  to  operationally  defired 
dependent  variables  and  to  develop  a body  of  knowledge  for  such 
independent-dependent  variable  relationships,  and  the  interactions 
across  classes  of  variables.  Major  factors  are  prcbably  going  to 
be  in  the  general  areas  of  infomation  processing  c^jability  of 
the  caimand  team,  the  team  decision-making  process  enployed  and 
the  structural  relationship  among  members  of  the  caimand  team. 

8.  Decision  making  strategies.  This  area  differs  fron 
information  processing  in  that  the  strategies  of  cotmanders  or 
unit  lieads  probably  concern  more  the  type  of  information  used  for 
decisions,  and  the  manner  in  viiich  available  processed  information 
is  used  in  the  decisicn-making  process.  There  obviously  is  an 
interaction  betveen  the  decisicn  styles  of  "heads"  and  the  organ- 
ization's structure.  Sane  structures,  from  a methocio logical  view- 
point make  it  extremely  difficult  to  ascertain  vSiat  information 
entered  into  the  forming  of  the  decision.  In  seme  structures  the 
relative  balance  of  policy  vs.  data-type  information  frem  external 
and  internal  envirorments  may  be  different  frem  the  balance  found 
in  other  structures.  (That  is,  the  conventional  line-staff  struc- 
ture has  different  functional  preperties  frem,  say,  a lattice 
structure.)  The  quality  of  decisions  and  the  strategies  for  deci- 
sion-maJeing  may  depend  on  that  type  of  balance,  among  other  factors. 
The  utility  of  investigating  differences  in  decisiesi  strategy  stems 
from  the  potential  payoff  for  such  knowledge  for  application  to 
training. 

9.  Role  separation  between  caimander  and  staff.  Maximizing 
the  effectiveness  of  caimand  and  control  teams  probably  requires  - 
as  the  literature  seems  to  suggest  - a separation  of  responsibility 
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for  routine  (primEirily  procedural)  and  non-routine  tasks.  While 
such  separation  occurs  new  to  varying  degrees  the  demarcation  is 
often  less  than  crystal  clear  and  more  than  a little  bit  arbitrary. 
Perhaps  this  is  because  the  routine  - non-routine  dimension  is 
often  less  of  a dichotemy  and  more  of  a continuum  than  is  usually 
imagined.  Figure  1 is  a schematic  of  the  major  functions  or  pro- 
cesses occurring  in  the  tactical  operations  center  of  an  army 
division  or  corps  vdiich  portrays  such  a dichotony  in  terms  of 
"rule- followers"  and  "rule  makers".  While  this  is  a convenient 
way  of  conceptualizing  a major  functional  difference  particularly 
fran  a point  of  view  of  defining  manageable,  meaningful  research 
chunks,  it  too  is  arbitrary  and  the  dichotemy  may  be  more  apparent 
than  real  depending  on  ther  personages  involved  in  these  functions. 
Also  related  to  this  issue  is  the  question  of  centralization/decen- 
tralization of  responsiblity  and  authority.  The  transition  from 
reasonable  delegation  to  micro  management  is  made  all  the  more 
taipting  by  the  availability  of  automated  information  systems. 


If  further  "noise"  were  needed  in  our  atteirpts  to  better 
understand  the  influence  of  the  above  variables  and  issues  then 
we  are  in  luck  because  most  of  the  above  are  in  sane  vgay  affected 
by  a host  of  enviromental,  psychological  and  sociological  fact- 
ors, e.g.,  stress,  motivation,  fatigue  etc.  Introduction,  con- 
trol, manipulation  eind  measurement  of  such  factors  for  experinen- 
tal  purposes  within  the  broader  context  of  conmand  and  control  is 
at  best  exceedingly  difficult  and  in  nany  instances  not  justifi- 
able in  a risk/benefit  analysis.  Whatever  variables  are  investi- 
gated, the  research  can  be  no  better  than  the  criteria  and  measures 
of  performance  or  effectiveness.  Accordingly  sane  of  the  consid- 
eraticffis  and  problems  involved  in  determining  vtot  should  be  mea- 
sured, how  it  should  be  measured  and  how  one  can  interpret  the 
outcone  will  next  be  discussed. 

3.0  MeoAu-’iCffieitt.  The  answers  one  gets  to  questions  of  role, 
inportance  and  interactions  of  the  numerous  variables  vdiich  might 
be  influencing  the  effectiveness  of  cotrand  and  control  functions 
and  sviicems  is  very  much  dependent  r^n  what  is  measured,  the 
circimstance  of  its  measurement  and  the  scoring  or  weighting  of 
the  outcones.  While  there  are  many  lessons  that  can  be  learned 
fron  actual  war  time  operations,  there  are  itany  reasons  too  obvi- 
ous to  discuss  why  research  should  not  and  cannot  depend  on 
availability  of  such  circunstances.  For  battlefield  information 
systans  at  least,  this  means  sane  sort  of  eibstraction  or  simula- 
ticxi  of  the  real  world.  The  key  element  in  such  a procedure  is 
bo  insure  that  sufficient  fidelity  to  the  real  world  is  retained 
that  you  have  confidence  in  the  outcome  at  least  in  terms  of  the 
relative  order  of  alternatives  and  tlat  sufficient  control  can  be 
exercised  to  allcw  attribution  of  effects  to  specific  variables 
or  their  ccmbinations. 

A man-in-the-loop  interactive  simulation  is  used  at  the  Army 
Research  Institute  as  one  vehicle  for  the  development  and  otpiri- 
cal  evaluation  of  raan/pixcedure/equipment  alternatives.  This 
vehicle  or  reseeurch  tool  is  called  SIMTOS  vMch  stands  for  Simu- 


lated  Tactical  Operations  Systan.  Its  resanblanoe  to  any  specific 
Tactical  Operations  Systan  past,  present  or  future  in  terms  of 
hardware  or  software  design  conc^Jts  in  at  most  svperficial.  It 
does  attanpt  a reasonable  incorporation  of  the  peopleware  factor 
and  allows  representation  of  the  functicxis,  interfaces,  and  infor- 
mation content  vrfiich  would  characterize  a TOS.  Figure  2 identifies 
the  principle  corponents  of  the  simulaticai  and  the  play  options.  A 
more  detailed  descriptiOTi  is  available  for  anyone  interested  [2], 
Not  all  variables  can  or  perhaps  should  be  included  in  the  system 
simulation.  A frequently  used  approach  is  analogous  to  that  of 
Spaulding  et  al  [s]  learning.  In  the  research  setting  a small 
subset  of  variables  or  processes  may  be  investigated  in  a tactical 
problem  slice  vrfiich  allows  a better  understanding  of  the  under- 
lying dynamics  and  sensitivities.  Gradually  that  ^diich  shows 
greatest  proniise  becomes  integrated  with  other  substructures  and 
ultimately  is  scrutinized  in  the  full  simulation. 
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Figure  2.  Characteristics^ Components  and  Player  Options  in  SIMTOS 


But  vAiat  measures  of  perfontance  should  one  use?  Other  things 
being  equal  we  tend  to  feel  most  ccmxsrtable  with  objectively  de- 
termined nunbers  but  it  depaids  on  what  is  being  measured  whether 
such  quantification  is  feasible  and  Vihat  the  unit  of  measuranent 
should  be.  Referring  back  to  Figure  1 you  will  see  that  a dis- 
tinction is  made  betvireen  the  information  processirq  activities  and 
the  decision  making  activities.  In  the  former,  measures  of  infor- 
mation processing  efficiency  are  indicated.  These  typically 
include  speed,  accuracy,  conpleteness,  etc.  This  seans  straight 
forward  enough  but  since  frequently  we  can  inprove  accuracy  at 
the  expense  of  coipleteness  or  vice  versa  and  either  might  be 
inproved  at  the  expense  of  time,  trade  offs  must  be  explicitly 
considered  and  perhaps  a variable  weighting  scheme  derived.  At 
this  point  we  find  a need  to  go  to  the  next  higher  functicaial  level 
where  hcpefully  we  can  assess  the  importance  of  these  measures  in 
terms  of  their  impact  on  decisicm  making  activities.  But  wfat 
measures  of  effectiveness  do  we  use  to  evaluate  decision  behaviors? 

Initially  in  SIMTOS  performance  was  evaluated  against  "school 
solutions"  generated  frcxti  the  collective  judgement  of  military 
experts.  Such  criteria  have  merit  in  berms  of  being  obtainable 
vAien  other  more  objective  measures  are  not  and  frequently  prove 
less  costly  than  developing  the  means  to  assess  performance  in 
terms  of  what  was  won  and  lost.  With  the  addition  of  appropriate 
engagement  tables,  accounting  routines  etc.  to  SIMIDS  it  is  now 
customary  to  assess  outcomes  in  terms  of  meeisures  shown  in  Figure 
3.  A word  of  caution  is  in  order  here.  Less  than  optimum  and  even 
wrovg  decisions  can  result  in  favorable  outcomes.  This  is  as  true 
in  every  day  life  as  it  is  in  tactical  simulations.  Accordingly 
it  can  be  of  value  to  recover  data  which  will  allow  an  interpre- 
taion  of  outcomes  in  light  of  deviaticais  of  behavior  at  decision 
nodes  from  that  of  the  school  solution.  Even  given  the  measures 
of  Figure  3,  it  requires  no  special  genius  to  recxcgnize  that  the 
weighting  problem  has  not  been  obviated. 
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SIMTOS  SCORING  CRITERIA 


MEASURE 

TERRITORY 

TIME 

FRIENDLY 

ENEMY  ATTRITION 


REMARKS 

LOST,  GAINED,  CONTROLLED 

TO  ACCOMPLISH  MISSION 

NUMBER  (*•  PERSONNEL, 
EQUIPMENT,  SUPPLIES 

NUMBER  OF  PERSONNEL, 
EQUIPMENT,  SUPPLIES 


RESOURCES  EXPENDED  ANCUNT  CF  AMMO,  AIR 

SORTIES,  ETC. 

FORCE  READINESS  LEVEL  % PERSONNEL,  EQUIPMENT  BASIC 

LOAD  AVAHABIE  UPON  COMPLETICN 
OF  BASIC  MISSION 

Figure  3.  Scoring  Criteria  Used  in  Assessing  Outcones  of  SIMTOS 
Play. 

At  this  point  one  might  vender  if  etrpiriciam  is  verth  the 
effort.  Probably  much  of  vdiat  we  learn  is  logically  or  intuitive- 
ly obvious  and  v^t  isn't  is  determinable  by  asking  knofledgeable 
users.  This  notion  will  now  be  examined  a bit  more  closely. 
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4.0  Some  Attoma£oai  F-indtnqi.  If  in  fact  the  answer  to  esqaerimen- 
tal  questions  could  always  be  predicted  there  vould  be  little  need 
for  experimentation  or  analytic  investigation.  Not  only  is  that 
not  the  case  but  often  when  a favorite  hypothesis  is  contra  indi- 
cated by  data  we  improve  our  understanding  of  the  phencmena  far 
more  than  we  would  have  had  our  hypothesis  been  confirmed.  I will 
describe  sate  findings  vAiich  I feel  support  this  viewpoint. 

There  are  three  pieces  of  research  related  to  informatics 
requirements  vdiich  are  illustrative  of  the  above.  In  one  effort 
[4]  an  attempt  to  get  a better  handle  on  the  information  require- 
ments of  a division  G-3  resulted  in  a conarison  of  survey  data 
with  SlMTCe  data  on  the  same  division  level  scenario.  It  was 
found  that  the  level  of  information  detail  identified  as  needed 
for  mission  acccrplishment  by  those  surveyed  was  not  used  by  a 
similar  gtoi;^)  of  SIMTOS  players  with  the  same  mission.  This  of 
course  suggested  that  people  ask  for  more  information  than  they 
need  on  the  asunption  that  if  it  turns  out  to  be  relevant,  it  will 
be  available,  if  not  so  vhat.  Aside  frcm  irrplications  for  cotipu- 
ter  memory  in  autonated  systems,  the  asstsiption  tlat  "more"  is 
better  even  if  the  "more"  is  relevant  must  be  seriously  questioned 
in  light  of  findings  in  a 1962  study  by  Hayes  [10].  There  in  the 
context  of  an  air  defense  problan  Hayes  found  that  beyond  seme 
point  the  addition  of  more  information  though  highly  relevant 
tended  to  degrade  performance.  Finally  a reduced  detail  map  and 
a standard  map  were  compared  in  terms  of  effectiveness  for  sip- 
porting  both  planning  and  combat  requiran®nts  for  SIMTOS.  No 
significant  performance  differences  were  obtained  though  seme 
users  of  the  reduced  detail  map  subjectively  judged  their  naps, 
inadequate  [ 6] . 

In  another  recent  study  [9]  the  utility  of  autanating  seme 
of  the  analysis  and  production  tasks  associated  with  tactical 
order  of  battle  processing  was  explored.  In  the  caparison  of 
automated  and  manual  methods  the  accuracy  and  capleteness  of 
perfomance  in  the  automated  mode  was  better  but  there  was  no 
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difference  in  coipletiai  time^.  Since  the  participants  were  not 
instructed  to  eitphasize  one  thing  over  another  nor  were  they  pro- 
vided a time  constraint  one  would  e^qaect  autonation  to  be  faster, 
j That  finding  led  to  the  speculation  that  in  the  real  world  the  most 

easily  defined  standard  by  vdiich  to  judge  the  effectiveness  of  an 

analyst's  work  is  time  because  the  criteria  of  correctness  are 

I 

i frequently  lacking,  and  feedback  for  performance  on  that  dimension  ] 

is  seldcm  provided.  However  failure  to  provide  the  product  in  a ! 

timely  manner  invariably  results  in  a negative  feedback.  Thus  the 

ij  analyst  is  conditioned  to  behave  in  accordance  with  sane  systan  j 

ji  time  function  though  there  is  no  evidence  that  the  time  function  j 

j should  be  the  controlling  variable  to  itaximize  overall  effective-  j 

ness.  i 

! Incorplete  data  fran  a study  which  is  still  in  progress  ] 

and  being  conducted  in  a ccnrHnd  and  control  test  bed  environment  i 

suggests  that  the  better  battalion  conmand  groups  (as  defined  by  j 

‘ having  effective  procedures  for  staff  interaction  and  ccrmand  and  ] 

control)  may  perform  less  vrell  in  at  least  one  type  of  operation  - j 

! the  covering  force  mission.  The  key  prcblan  seems  to  be  excessive  i 

j centralization  of  the  decision  process  which  results  in  an  inabil-  i 

! ity  to  make  critical  decisions  within  the  narrow  tiite  window  avail-  j 

I able  for  mission  aocoiplishment.  While  there  may  be  several  al-  i 

j temative  ejqjlanations  to  accoont  for  this  behavior  and  it  is  too  | 

j early  to  choose  among  them,  one  can't  overlook  the  possibility  that  i 

j the  critericsi  for  "better  ccrmand  groups"  may  be  erroneous. 

! As  a final  exaitple  another  study  which  is  currently  on-going 

I is  cdiparing  manual  and  ccrputer  aided  performance  in  a movement 

I analysis  task.  The  carputer  aid  is  based  on  a moderately  ccrplex  j 

I algorithm  which  ccrputes  shortest  path/nuniimn  time  for  as  many  as  j 

I j 

1 : 
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10  units  to  10  possible  destinations  taking  into  account  type  of 
unit,  road  conditions,  weather,  time  of  day  etc.  It  is  neither 
feasible  nor  necessarily  desirable  for  all  factors  which  might 
bear  on  route  selection  to  be  autanatically  taken  into  account. 

As  an  aid  it  is  envisioned  that  a potential  solution  would  be  out- 
put which  would  be  critically  evaluated  and  modified  by  the  user 
in  light  of  special  considerations  which  cannot  be  mirrored  in 
ccitputer  software.  Observations  to  date  indicate  that  partici- 
pants in  the  cdded  mode  oroe  having  input  the  parameters  of  a 
given  problem  blindly  accept  the  preferred  solution  without  even 
visually  inspecting  the  routes  on  a map.  Yet  in  the  manual  mode 
a tentative  solution  once  arrived  at  is  subjected  to  a most  care- 
ful scrutiny  which  frequently  results  in  change.  While  there  has 
been  fear  ejqjressed  that  the  introduction  of  coiputers  would  be 
resisted  ty  thoae  who  feel  the  human  decision  maJcing  prerogatives 
are  being  relinquished  to  an  inanimate  beast  that  can’t  possible 
teve  the  versatility,  experience,  creativity  and  other  intangible 
assets  that  the  hunan  can  bring  to  bear,  these  fears  seem  not  to 
be  reflected  in  any  challenge  or  even  review  of  the  conputer  out- 
put. Thus  the  researcher  and  developer  must  be  aware  not  only  of 
those  who  have  no  trust  in  autcmation  when  they  should  tut  also 
those  who  trust  unquesticxiingly  when  they  should  be  skeptical. 

If  you  have  the  inpression  that  there  is  much  more  still  un- 
known than  known  in  regard  to  c^timally  melding  hunan  processing 
capabilities  and  limitations,  informaticn  properties  and  parameters, 
and  ADP  hardware  and  software  capabilities,  you  are  probably  cor- 
rect. Efforts  wall  continue  toward  resolving  seme  of  these  ques- 
tons  but  undoubtedly  decision  must  be  nade  regarding  the  charac- 
teristics to  be  required  of  interim  battlefield  information  sys- 
tans  before  all  the  answers  are  in.  Indeed  there  is  reason  to 
believe  that  an  ultimate  system  is  not  attainable  in  the  foresee- 
able future  and  the  acquisition  and  evolutionary  enhancement  of  a 
succession  of  upward  conpatible  intcarim  systems  in  a viable 
approach  assuming  cost  effectiveness  for  each  iteration  can  be 


226 


demonstrated  and  there  is  conconitant  research  to  insure  the  up- 
grading technology  is  available.  There  are  risks  associated  with 
virtually  all  R&D  efforts  and  in  the  absence  of  definitive  perfor- 
mance data  one  must  be  particularly  alert  to  overly  cptimistic 
technological  premises  and  the  ensuing  predicaments  which  are  best 
avoided. 

5.0  PfionciU  and  P^etUcamenti . Expected  advances  in  computer 
systems  based  mainly  on  large  scale  integrated  circuit  technology 
could  lead  one  to  believe  that  the  answers  to  most  of  our  cenmand 
and  control  problans  is  near  at  hand.  Radical  reductions  in 
physical  dimensions  and  poher  consumption  concemitant  with  in- 
creased speed,  manory  capacity,  ruggedness  and  reliability  and  at 
less  cost  are  already  being  realized  to  seme  degree.  Intelligent 
terminals  should  greatly  facilitate  man-oemputer  interactions. 

It  is  predicted  that  by  1980  advanced  intelligent  terminals  will 
accept  100  to  200  word  speech  input  and  have  a voice  response  for 
a 2000  to  3000  word  vocabulary.  While  the  above  bodes  well  in 
terms  of  exploitable  potential  there  still  is  a long  way  to  go  in 
reducing  the  gap  between  the  promise  and  reedity  of  user  perfor- 
mance within  interactive  cotputer  systems. 

It  still  seans  appropriate,  in  spite  of  or  perhaps  because 
of  the  above,  to  continue  focusing  attention  on  aiding  and  cem- 
plementing  rather  than  replacing  the  human  in  future  systans. 
Humans  have  limitaticais  but  so  do  cenputer  systans.  It  may  be 
enlightening  to  review  seme  instances  wiiich  tend  to  reinforce  the 
notion  that  great  care  should  be  exercised  before  designing  the 
hunan  out  of  the  loop. 

It  is  virtually  iirpossible  to  guarantee  a large  cotputer  pro- 
gram to  be  free  of  error.  Large  systans  ccxisist  of  hundreds  of 
thousands  of  instructions  and  wtiile  checkout  and  exercising  wall 
uncover  most  errors  the  occasional  one  that  slips  by  can  cause 
semething  of  a sensation.  For  instance  in  1971  a progranming 
error  caused  a French  weather  satellite  to  unintenticxially  destroy 
115  weather  balloons  it  was  trying  to  interrogate  [1]. 
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While  this  was  not  a catastrophic  occurrence,  in  a slightly  diffe- 
rent context  it  could  be.  One  need  only  to  extrapolate  fron  the 
reported  time  v*en  an  early  version  of  the  Ballistic  Missile  Early 
Warning  Systan  software  allowed  the  rising  moon  to  be  mistaken  for 
a missile  raid  [7].  That  software  to-day  is  both  a big  and  costly 
problem  can  be  gleaned  from  Figure  [4].  If  the  probability  of 
error  increases  proportionately  or  even  nonotonically  with  the 
amount  of  software  code  written  then  there  is  a basis  for  sane 
trepidation  in  the  size  of  those  expenditures. 

ANNUAL  WEAPCW  SYSITM  SCFTOARE  COST  ESTIMATE  — $1.4  BILLION 

0 DIRECT  COST  (»ILY 

0 EXCLUDES  INTELLIGENCE,  NON-TACTICAL  C^,  LOGISTIC 
APPLICATICNS 

0 CONSERVATIVE  ESTIMATE 


WEAPC»i  SYSTEM  INVOLVING  SOFTWARE  — 115 

0 APPROX  50%  IN  DEVELOPMENT 

0 APPROX  50%  O&M 

Figure  4.  The  DOD  Software  Iceberg 

A human  operator  may  be  able  to  corpensate  for  system  un- 
reliability or  malfunction.  For  instance  in  the  Ganini  VI  mission, 
on  board  instruments  indicated  that  lift  off  was  initiated  but 
sufficient  thrust  was  not  being  generated  to  conplete  lift  off. 
tfelly  Shirra  sensed  that  lift  off  had  not  been  initiated  and 
therefore  did  not  take  anergency  measures  to  eject.  As  a conse- 
quence vhat  might  have  been  an  aborted  mission  was  instead  a 
success  [5].  Eton  is  inherently  more  flexible  and  adaptable  to 
new  and  unusual  situations  than  are  autonated  systems.  Typically 
autcmated  systems  are  designed  to  ccpe  with  hafpenings  which  can 
be  preplanned.  Hcwever  for  information  systems  for  the  battle- 
field such  plans  may  be  the  first  casualty  of  war  thereby  probably 


rendering  these  systans  far  less  effective  than  had  been  antici- 
pated. Essentially  in  the  problan  solving  darain  coiputers  excel 
mainly  on  those  problans  that  are  well  defined  and  quantitative. 

To  a large  extent  the  corputer  is  dependent  on  man  to  provide  the 
numbers  - a task  which  man  often  does  rather  poorly.  None  the 
less,  once  generated,  massaged  in  the  coiputer  and  regurgitated 
in  sane  aggregated  form,  all  traces  of  their  questioiable  ancestry 
are  forgotten  and  an  aura  of  respectability  that  many  accept  with- 
out question  is  radiated. 

The  need  for  advances  in  comand  and  control  capability  is 
unquestioned.  That  these  advances  concern  the  ability  to  deal 
effectively,  efficiently  and  rapidly  with  all  dimensions  of  infor- 
mation seems  self  evident.  That  autonaticii  is  necessary  but  not 
sufficient  for  satisfying  this  need  is  suggested.  That  efforts  be 
continued  to  more  fully  understand  both  hvxnan  and  cotputer  pro- 
cesses and  characteristics  requisite  to  defining  the  optirmia 
synergistic  relationship  for  meeting  the  caimand  and  control 
challaige  is  urged.  And  finally  it  is  hoped  that  in  future  decades 
we  will  not  look  back  on  the  present  decade  and  again  say  [11] 
that  no  major  military  comand  information  syston  has  been  devel- 
oped within  original  cost  and  schedule  estimates  and  still  met 
I its  original  performance  objectives. 
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CCMftND,  CXWTROL,  OOMMJNICATION  AND  TEAM  DITCISIOJ  'IHBORY 
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UniveAi^y  :>cuthe'in  CaZifiOfLnia 


AbitAact.  The  coordination  of  decisions  under  uncertainty  in  a 
team  leads  to  optimality  conditions  that  are  integral  equations. 

A specific  example  of  a two-division  firm  is  develc^^d  to  illu- 
strate these  conditions.  Numerical  imbedding  techniques  are 
used  to  solve  the  firm's  decision  problem.  Extensions  toward 
more  general  techniques  and  applications  are  indicated.  These 
are  clear  inplications  for  the  problan  of  avoiding  chaos  under 
conditions  of  inpaired  ccrtnunication  between  centers. 

? . 0 I nVioduction . Organizations  face  decision  problems  that  are 
more  ccmplex  than  the  problems  of  a single  agent.  As  Radner  [17] 
points  out,  there  may  be  differences  among  martbers  of  the  organ- 
ization with  respect  to  possibilities  of  action,  information, 
and  preferences.  In  additicxi,  there  nay  be  uncertainties  about 
the  actions  of  other  members,  making  coordination  difficult.  The 
theory  of  team  decisions  ignores  the  possibility  of  internal  dif- 
ferences in  preferences  in  order  to  concentrate  on  the  study  of 
how  ccmainicaticai  helps  coordinate  the  decisions  of  individual 
members. 

In  this  paper,  we  look  at  the  specific  problan  of  ccrputing 
cptimal  decision  rules  for  a team  with  a given  conminication  or 
information  systan.  The  optimal  decisicai  rules,  it  turns  out, 
must  satisfy  a systan  of  integral  equations  which  can  be  quite 
corrplicated  in  general  (non-linear,  infinite  limits  of  integra- 
tion, with  multiple  variables  of  integration) . Previous  works 
in  team  theory  have  circunvented  these  difficulties  by  selecting 
problans  with  kncwn  solutions.  Algoritlms  for  the  solution  of 
the  general  problan  have  not  yet  been  developed,  but  we  have 

* Rand  Corporaticm,  Santa  Monica,  California  90406. 
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taken  a first  step  in  that  direction  by  applying  an  imbedding 
technique  to  a specific  numerical  problem  which  does  not  have  a 
closed-form  solution. 

Section  2 sutmarizes  the  decision  problan  of  a multimanber 
team.  Section  3 looks  at  an  economic  application  with  the  typi- 
cal computationally  conplex  team  problem.  Section  4 presents 
nimerical  results  for  this  team  decision  problan.  Major  applica- 
tions in  caimand  and  control  might  be  in  avoiding  chaos  under 
conditions  of  degraded  ccitinunication  between  sub-units.  Section 
5 sketches  one  such  example.  Conclusions  and  discussions  cure 
found  in  Section  6. 

2.0  Team  Vecci'COii  Theo'Li/.  A team  is  an  organization  vAiose  mem- 
bers share  a single,  well-defined  objective  function.  Such  a 
harmonious  group  has  but  one  problem:  how  are  individual  activ- 
ities coordinated  in  an  optimal  fashion?  Team  decision  theory 
explores  such  problems  viisn  the  organization  is  uncertain  about 
its  envirorment  and  v4ien  information  about  the  environment  differs 
among  team  members.  The  decision  problem  reduces  to  the  selec- 
tion of  rules  of  action  that  coordirrate  the  interdependent  activ- 
ities of  the  teanmates  to  maximize  the  expected  payoff  of  the 
team. 

Organizations  are  seldon  harmcnious  and  a game-theoretic 
model  may  seen  more  apprc^riate  than  a team- theoretic  model. 

Since  team  theory  is  an  element  of  a more  general  normative 
approach  to  the  problerri  of  "organization",  Marschak  ard  Radnor 
[15]  emphasized  harmony  in  order  to  study  the  use  of  coimunica- 
tion  in  the  tcisk  of  coordinating  actions.^  Team  decision  theory 
is  an  extension  of  Bayesian  statistical  decision  theory  to  a 
raultlmember  organization.  The  basic  difference  between  these 
two  decision  theories  is  that  the  information  provided  each 
team  member  may  be  different.  In  statistical  decision  theory 
the  action  may  consist  of  several  caiponents,  but  each  ccrpo- 
nent  decision  is  based  on  the  same  information. 
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The  team  cxjnsists  of  n cJecision  itakers  or  teanmates, 
indexed  by  i = 1,  2,  n.  The  basic  elements  of  tte  team 

decision  problem  are  as  follows: 

0 c 0 C R : the  unknown  state  of  nature; 

A = (a,  ,...,a„)  £ A C r"^:  the  actions  of  the  teairmates; 

In  — 

U(A, 0):  the  team's  utility  function; 

Y = (yj^,y2/ • • • E A C R*^:  the  information  of  the  teanmates;^ 

f(0):  the  team's  prior  probability  density  of  0; 

f(Y|0)  : the  team's  conditional  prior  prc±ability  density  of  Y 
given  0; 

a(Y)  = (aj^(y^) , . . . ,aj^(y^) ) e A:  the  team  decision  function.^ 

The  crucial  points  to  notice  are:  (a)  there  is  only  one  utility 

function,  agreed  upon  by  all  manbers,  (b)  the  utility  function  is 

not  necessarily  separable;  that  is,  in  general,  U ^0, 

®i®j 

(c)  there  is  only  one  pair  of  prc±ability  densities,  f(0)  and 
f(Y|0),  agreed  V5»n  by  all  members,  (d)  the  information  of  the 
ith  teammate,  y^,  is  different  frcm  the  jth  teamnate's  informa- 
tion, y^,  and  (e)  since  the  ith  teammate  knows  only  y^,  his 
action  depends  only  on  y^;  i.e., 

®i=  i<yi)- 

Each  teammate  wants  to  select  decision  rules  that  are 
coordinated  to  maximize  the  team's  expected  utility 

W[a]  = /g/yU(a(Y),0)f(Y|0)f(0)dYd0.  (2.1) 

How  can  we  characterize  the  optimal  decisicxi  rules  for  the 
teammates?  Let  a* (Y)  denote  the  optimal  decision  rule;  that 
is 

W[a*]  > w(a] 
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for  all  decision  rules  a e A.  Any  arbitrary  decision  riile  can 
be  written  as  a^* (y^)  + (y^)  where  6^  is  an  arbitrary 

scalar  and  ® function  of  the  ith  teanmate's  informa- 

tion. Thus,  any  team  decision  rule  can  be  expressed  as 


a(Y)  = a*(Y)  + I>y(Y) 


wfere  D is  a diagonal  matrix  with  elements  6j^,52>  •••> 

along  the  diagonal  and  y(Y)  = (YQ^(y2^),  Y2(y2^ ' • * • 'Yn^^n^  ^ ^ 

Tie  optimality  of  a*(Y)  is  r^resented  by  the  marginal  condi- 
ticxis 


3W[a*-H>y] 

36. 

1 


.=6  =0 


n 


= 0,  i = 1,2, 


,n 


(2.2) 


for  all  Y e Radner  [16]  has  shown  that  these  conditions 
(2.2)  can  be  expressed  as  follows: 

Theorem  (Person-by-Person  (^timality) : If  a* (Y)  is  the  opti- 
mal team  decision  rule  then  it  nust  satisfy  the  follcwing  equa- 
tions: 


0 = / ...(i).../  (a*(Y),e)f(y(i),0|yJd6dY(i)  (2.3) 

1 n ° ®i  ^ 


for  all  y^  e Here  f (Y(i)  ,0  [y^)  = f (y  1 0)  f (e)/f^(y^)  is  the 

posterior  probability  of  Y(i)  h (Vj^r  • • • • • fY^)  given 
y^.^  The  equaticxis  (2.3)  can  be  written  succinctly  as 

£{0,  (a*(Y),0) ly.)  = 0 for  all  y.  e Y . . (2.4) 

a • 1 i J. 

1 

The  optimality  COTYditions  are  called  "persc*i-by-person"  because 
they  have  the  interpretation  that  the  ith  teanmate,  assuming  his 
colleagues  are  using  their  best  decision  rules,  picks  a decision 
nde  such  that  his  posterior  expected  marginal  utility  equals 
zero  no  matter  what  information  he  might  receive. 
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The  optimality  cxjnditions  for  the  single  agent  statistical 
decision  problan  are  similar  to  (2.3)  but  not  nearly  so  ccmpli- 
cated.  In  statistical  decision  theory,  the  single  decision 
maker  has  the  privilege  of  waiting  until  the  information  is 
obtained,  modifying  his  probability  judgments  usii^  Bayes  rule, 
and  then  selecting  a single  action  to  maximize  posterior  expected 
utility.  The  ith  teanmate  cannot  delay  caiputation  of  his  entire 
decision  function  because  other  teanmates  must  know  his  decision 
rule  in  order  to  predict  his  actions  and  thus  coordinate  their 
decisions.  The  person-by-person  optimality  conditions  must  be 
solved  simultaneously  before  the  information  is  gathered. 

The  person-hy-person  optimality  conditions  (2.3)  are,  in 
the  most  general  case,  a non-linear  interdependent  system  of 
integral  equaticns.  In  seme  inportant  special  cases  the  solution 
is  relatively  easy.  Most  analytic  ccaitributions  to  team  theory 
have  concentrated  on  these  specific  solutions.  However,  for 
slightly  different  problans,  the  corputation  (on  the  back  of  an 
envelope  or  numerically)  of  o*(Y)  is  non-trivial.  The  appli- 
cation of  team  theory  to  more  realistic  problems  requires  the 
development  of  algorithms  for  the  solution  of  person-by-person 
optimality  conditions. 

3.0  Muiti-div-ci-conaX  F-Om;  Q_iUitPiatic-Un,L^ofim  Exampie.  Suppose 
a firm  c»nsists  of  two  autonomous  divisions  who  produce  different 
cenmodities  in  the  amounts  a^^  and  a^,  respectively.  The  com- 
modities are  sold  in  a cxjipetitive  market  at  prices  and  P2. 

Because  of  randan  variations  in  supply  and  demand,  the  prices 
ate  not  knewn  precisely  until  the  instant  the  cenmodities  are 
sold.  Each  division  separately  gathers  information  about  the 
market  it  sells  in  and  uses  this  information  to  help  select  its 
quantity  of  output.  Let  y^  be  the  "price  forecast"  \diich  the 
ith  division  uses  in  its  decision  making.^ 

The  firm's  total  revenue  is  Pj^a^^  + P2a2.  Suppose  that  the 
total  cost  to  the  firm  of  producing  quantities  a^^  and  a2  is 


C(aj^,a2)  = 1/2  + 0^232  ^22^2^' 

Notice  that  since  Cj^2  i®  non-zero,  there  is  an  interdependence 

between  the  production  in  t.o  divisions.^ 

Assure  that  the  firm  believes  that  the  relative  orices  of 
its  two  ccmnodities  are  fixed  but  is  uncertain  about  the  price 
level.  That  is,  the  price  vector  that  will  be  observed  is 
(P^e,P20)  where  6 is  a randan  variable  and  Pj^  and  P2  are 

fixed  nunbers.  The  expected  profit  of  the  firm  is 

E{  0 (Yj^)  + P2a2(y2))  - 1/2  “ *-12“l^^l^“2*y2^ 

^22“2^^2*  ' 

Si^pose  that  the  price  level,  0,  and  price  forecasts  of  the 
individual  divisions,  and  are  uniformly  distributed 

with  the  joint  probability  density 

13  0£yj^l®^l/0£y2l®ll 

(3.1) 

0 elsevhere. 

One  can  calcuate  the  needed  posterior  probability  densities 
without  much  difficulty.  They  are  given  here  in  closed  form. 

20 


:(e|yi) 


y.  j<  0 < 1, 

i-yi‘ 

0 elsevhere; 

2(l-max[yj^,y2]) 


(3.2) 


1-y. 


0 1 Yj  1 1' 


(3.3) 


0 elsevhere. 

Using  these  posterior  probability  densities,  the  optimal 
decisi(»i  rules  aj^*(y^)  and  “2*(y2^  must  satisfy  the  follow- 
ing systan  of  linear  Fredholm  integral  equations: 
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^iMyi)  = ^ 9 de  - 

^ ^ ^11  1-y, 


'12  ,1  _ > 2(l-max[y^,y2]) 

' “?  (y?)  T 


dy2  = (3.4) 


^ ‘^12  .1  X,  . 

^ T ” r •'n  “o  (y?) 

^11  ^11  ° ^ 


2 ( 1-max [yj^,y2] ) 
TTT^ 


*/  ^ 2 ,1  . 20 

“2  ^^2^  = C — ® 

<-22  ^2  l-y„ 


12  ,1  , 

^0  “i*(yi) 


2 (l-max[yj^,y2] ) 


dy^  = (3.5) 


, ^2  ^ ^2  ^12  .1  * , 

2/3  g ^ ^ — f a2*(y,) 

^22  1-y,^  *^11  “ 1 


2 (l-max[yj^,y2] ) 


4.0  NumeA'icai  Solution.  The  integral  equation  (3.4)  and 
(3.5)  of  the  quadratic-uniform  team  exanple  are  of  the  follcwing 
form 

u(t)  = gj^(t)  + /q  K^(y,t)v(y)dy  0 1 t £ 1, 

v(t)  = g2(t)  + /J  K2(y,t)u(y)dy  0 < t < 1. 

The  forcing  functions  are  identical  except  for  multiplication 
a scalar,  g^(t)  = k g2(t).  Similarly,  the  kernels  differ  only 

by  multiplication  by  a constant,  Kj^(y,t)  = hK2(y,t).^  The  ker- 
nels can  be  written  in  the  following  form 


I 


[ 


f 


f- 


( 

1 


(t)  0 1 y 1 1 

Ki(y,t)  = I 

^ Y£(t)  6^(y)  t _<  y £ 1. 

That  is,  the  kernels  are  sauidegenerate.  In  the  following  we 
want  to  apply  an  imbedding  technique  for  semidegenerate  kernels 
to  ccnpute  the  soluticai  of  (3.4)  and  (3.5). 

At  this  point  in  time  our  numerical  algorithm  can  hiandle 
only  a single  integral  equation.  As  a result  the  numerical  pro- 
blan  was  siitplified  assuming  that  the  multiplicative  constants, 
k and  h,  were  equal  to  one  (or  = C22  = P2)  • In  this 

symnetric  case,  both  integral  equations  are  identical  so  it  nust 
be  true  that  u(t)  = v(t)  for  0 ^ t ^ 1.  Hence  the  problem  re- 
duces to  the  solution  of  the  following  single  integral  equation: 

u(t)  = gj^(t)  + Kj^(y,t)u(y)dy.  (4.1) 

By  selecting  = 1 and  = 1 we  can  make  this 

more  specifically 

1-y,^  1 ad-maxlywy-]) 

u(y  ) = 2/3  ^2  - u(y  )dy  (4.2) 

1-y^^  “ l-y^'^  ^ ^ 

V nunerical  algorithm  is  based  on  the  solution  of  a class 
of  problans  indexed  by  an  u^jper  limit  of  integration,  x: 

u(t,x)  = g(t)  + K(t,y)u(y,x)dY,  0 < t £ x,  (4.3) 

vtere  the  kernel  K and  the  inhomogeneous  term  g sure  given, 
and  the  function  u is  to  be  determined  for  0 ^ t £ x . The 
particular  solution  u(t,l)  provides  the  solution  to  the  team 
problan. 

A FCJCTRAN  program  for  such  a nunerical  solution  is  given 
in  Kagiwada  and  Kalaba  [10].  The  nunerical  results  of  this  pro- 
gram for  the  integrcil  equation  (4.2)  are  given  in  Table  1.  As  a 
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Table  1;  NUMERICAL  SOLOTION  FOR  OPTIMAL  IBCISION  FUNCTION 

a^*{Y^)  Integration  step  size  = 0.01_^ 

0.0  0.3026 

0.1  0.3081 

0.2  0.3224 

0.3  0.3434 

0.4  0.3695 

0.5  0.3996 

0.6  0.4328 

0.7  0.4685 

0.8  0.5062 

0.9  0.5455 

1.0  0.5863 


I 


i 

j 
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check  on  the  results,  it  was  shown  that  the  solution  points  satis- 
fied the  trapezoidal  ^proximation  of  the  integral  equation  (4.2) 
with  an  accuracy  of  up  to  the  fourth  significant  figure. 

The  nimerical  solution  indicates  that  the  optimal  team  deci- 
sion rule  for  output  is  a nonotonically  increasing  function  of  the 
price  forecast.  That  is,  vihen  a division  feels  that  the  price 
level  is  going  to  be  low  then  it  should  produce  a relatively  small 
quantity  of  its  good;  \dien  the  price  level  is  forecast  to  be  high, 
the  divisiai  will  produce  large  amounts  of  its  good.  Also,  the 
numerical  soluticai  has  a distinctly  convex  shape  so  that  output  is 
more  sensitive  to  price  forecasts  when  y.  is  large  then  when  it 
is  anall.  When  price  forecasts  are  large  a bigger  gamble  can  be 
taken. 

5.0  AtcXtXtfu/  RzcotmcuAiance.  Ttami.  Team  decision  theory  is  well 
designed  to  handle  military  problems  of  coimand,  control  and  con- 
irunication.  The  typical  military  decision  prc±ilan  involves  sev- 
eral individuals  who  agree  on  an  organizational  objective;  the 
environment  of  a military  connander  is  often  uncertain  and  hence 
actions  are  taken  based  on  iitperfect  knowledge.  Coordination  of 
activities  may  be  vital,  yet  cairunication  may  be  severely  limited. 
W.  H.  Hartnan  [8]  motivated  his  investigaticai  of  team  theory  with 
the  follcwing  military  exaitple. 

A military  reconnaissance  team  must  locate  certain  features, 
such  as  a cave  suitable  for  a supply  depot  or  a path  suitable  for 
armored  equipment  in  a mountainous  or  jungle  terrain.  The  team 
is  divided  into  several  squads,  vdiich  must  search  vdiile  avoiding 
detection  by  the  enemy.  Radio  coimunicaticxi  between  squads  must 
be  minimized  to  prevent  discovery  and  attack  and  hence  the  team 
must  make  decentralized  decisiais. 

The  team  kncws  the  rough  local  features  of  the  territory  via 
old  surveys  or  satellite  photographs  but  is  uncertain  about  the 


randan.  The  squads  are  looking  for  the  same  type  of  object  but 
the  order  in  which  they  succeed  and  decisions  they  will  nake  to 
secure  the  objective  are  unJoicwn. 

The  reconnaissance  problem  requires  some  degree  of  coordi- 
nation between  autonomous  decision  makers.  For  given  coimunica- 
tion  structures,  optimal  strategies  should  be  provided  for  each 
squad.  At  a higher  level,  the  coimunication  structure  should  be 
selected  to  balance  the  payoffs  of  locating  a suitable  topograph- 
ical feature  and  the  costs  of  delays,  comiunicaticai  ard  personnel. 
The  theory  of  team  decision  making  is  an  obvious  tool  to  apply  to 
such  a coirand  control  and  catmunication  problan.  Further  re- 
search would  have  to  include  specifications  of  utility,  probabil- 
ity distributions,  carmunication  structures  and  cost  of  informa- 
tion. 

6.0  Conchii-Loni.  The  development  of  techniques  for  specifying 
optimal  decisions  v^on  there  is  uncertainty  and  information  about 
the  environment  has  had  a major  inpact  in  many  areas,  from  the 
management  of  corporations  to  the  actions  of  military  ccitmand. 

The  ^plication  of  this  statistical  decision  theory  was  greatly 
facilitated  by  the  develcpment  of  conjugate  probability  functions, 
nonlinear  optimization  procedures,  etc.  Team  decision  theory 
promises  to  open  new  frontiers  by  investigating  the  multiperson 
decision  prcAilems  involving  coimunication  and  coordination.  Team 
theory  has  existed  as  an  analytic  tool  since  the  work  of  Marschak 
in  the  early  1950 's  (Marschak  [13,  14]).  Yet  the  nunber  of  appli- 
cations of  team  theory  is  snail  (see  Beckmann  [4],  McGuire  [12], 
and  Kriebel  [11]).  This,  in  piart,  is  due  to  the  difficulties  of 
formulating  and  solving  the  taasic  team  decision  problem.  Numeri- 
cal techniques  have  not  been  applied  to  the  team  problem  and  hence 
most  studies  have  been  restricted  to  the  exanples  which  have  well 
)<no«i  closed- form  solutions. 

In  this  paper,  vre  atterpted  to  shew  how  one  step  can  be 
taken  in  the  direction  of  generality;  the  opitimality  conditions 
of  team  decision  tJieory  were  shown  to  be  amenable  to  solution  by 
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techniques  of  parametric  imbedding.  Itony  more  such  st^s  will 
iiave  to  be  added  before  ntmerical  soluticxis  of  more  difficult 
team  prtfclems  can  be  found  routinely.  We  only  need  to  point  out 
that  the  soluticxi  procedure  of  Section  4 was  dependent  upon  the 
quadratic  assutption  on  utility  functions,  the  ccrpactness  of  the 
interval  of  integratiOTi,  the  synmetry  assunpticns  that  reduced  a 
systan  of  integral  equations  to  a single  integral  equation,  and 
the  assunpticsi  of  a scalar  information  variable. 

One  justificaticxi  of  numerical  studies  is  that  numerical 
solutions  may  lead  to  insights  which  can  be  translated  into  heur- 
istic rules  of  thumb.  We  agree  that  the  numerical  approach  to 
team  decision  theory  will  reinforce  analytic  conclusicns  with 
respect  to  optinal  organizing  and  may  even  suggest  regularities 
that  should  be  investigated  with  analytic  techniques.  But  more 
subtly,  the  authors  feel  that  the  nunerical  techniques  may  provide 
new  analytic  approaches  to  the  study  of  team  theory.  In  particu- 
lar, the  pjarametric  imbedding  solution  technique  may  help  us 
analyze  the  theoretical  relationships  between  adjustment  of  para- 
meters and  change  in  decision  rules. 

Finally,  "pirocedures"  for  selecting  several  decision  rules 
to  opjtimize  a single  objective  functicn  are  the  topics  of  investi- 
gaticn  in  the  theory  of  decentralized  opjtimization.  The  theory  of 
decentralized  cptimizaticn  pioneered  by  Hurwicz,  Arrow,  Malinvaud, 
Dantzig  and  Wolfe,  should  provide  further  tools  for  investigating 

O 

the  solution  of  team  prctolems.  The  authors  have  begun  seme  pre- 
liminary studies  along  this  line,  and  hope  to  tie  them  into  the 
numerical  algorithm  discussed  in  this  paper. 

FOOTNOTES 

^ The  normative  theory  might  be  divided  into  three  stages:  (2.1) 
An  organization  must  create  a group  objective  function  by  consti- 
tutionally "aggregating"  individral  objectives  (see  Arrow  [1], 
DeGroot  [4],  cind  Dalkey  [5]).)  (2.2)  Individuals  must  be  motiva- 

ted to  act  with  the  group  objective  in  mind  (see  Groves  [7]) , and 
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(2.2)  Optinel  strategies  must  be  specified  for  individuals  (this 
is  the  basic  problem  investigated  in  team  decision  theory) . 

2 

Ihe  information  that  tlie  ith  teanmate  uses  may  come  fron  two 
sources,  a personal  observation  of  the  environment  or  a message 
from  another  teanmate  that  sutmarizes  his  kncwledge  about  the 
environment.  Hence,  it  may  sean  more  natural  to  maJce  each  con- 
ponent  y^  a vector  itself;  but  this  will  significantly  ccrpli- 
cate  the  results  that  follow  (see  Section  6 for  further  discus- 
sion) . One  might  imagine  that  the  vector  of  information  has  been 
reduced  to  a single  "statistic". 

^ The  function  space  ^ is  presuned  to  (oe  some  cotplete  normed 
linear  vector  space.  The  only  inportant  distinction  we  want  to 
maJte  is  that  the  ith  component  function,  “^(O,  depends  only  on 

^i- 

^ Radner  [16]  has  also  shown  that  differentiability  and  concavity 
of  U(A,  e)  in  A for  every  0 nakes  (2.3)  sufficient  as  well  as 
necessary.  Vfe  iiiplicitly  assure  throughout  that  U is  concave 
and  differentiable. 

^ There  is  no  coimunication  between  divisions  in  this  exaitple. 

The  ccirparison  of  expected  payoffs  with  various  ccmunicaticai 
structures  Ccin  le  found  in  Marsclial:  and  Radner  [15]. 

^ The  coefficients  are  assuned  to  satisfy  the  following  restric- 

2 

tions  > 0,  C22  > 0,  C^i^22  ^ '"12  ^ costs  are  convex 

in  output. 


7 


See  Arrow  and  Hess  [3]  or  Heal  [9]. 
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DESIRED  FEMTJRES  EX)B  MODELING  COMMAND,  CXKTROL,  AND  INFORMATICS 


^ ROBERT  F.  ROBINSON 
United  States  Air  Force 

The  objective  of  this  discussion  is  to  set  forth  a state- 
ment of  the  desired  features  for  means  for  analyzing  cotmand, 
control,  and  information  processes  in  theater  operations.  Thea- 
ter level  is  chosen  so  that  the  differences  in  the  kinds  of 
decisions  at  different  levels  of  the  hierarchy  can  be  examined. 
The  observatic*!  can  also  be  made  that  different  systems  operate 
into  the  various  elements  of  the  ccrmand  hierarchy.  The  need  is 
to  be  able  to  assess  changes  in  procedure  as  well  as  alterations 
in  the  systems.  These  procedural  changes  may  be  of  greater  sig- 
nificance than  the  available  system  changes. 

The  intenticn  in  this  discussion  is  not  to  offer  a solution 
or  a description  of  a particular  modeling  approach  but  rather  to 
suggest  a concept  for  a structure  so  that  analysis  of  cotmand, 
control,  and  information  systans  can  be  acoonplished.  Certain 
assunptions  are  made  in  this  discussicxi.  First,  ccrmunications 
can  be  modeled  rather  \«11.  Second,  sensor  systems  are  readily 
represented.  Third,  combat  interaction  processes  are  generally 
amenable  to  existing  techniques.  In  other  words,  the  means  for 
the  analysis  of  physical  processes  are  reasonably  well  in  hand. 
The  problem  is  the  means  by  which  ccmtand  and  decision  processes 
can  be  analyzed.  The  available  techniques  for  examining  of  these 
"social"  processes  in  military  cperaticns  leave  much  room  for 
develcptent. 

Vihile  the  purpose  is  methodology,  a useful  first  step  seems 
to  be  the  identification  of  sane  of  the  desired  qualities  that  a 
cormand,  control,  and  information  system  should  have.  The  model 
or  analytic  techniques  used  should  provide  the  means  to  assess 
whether  selected  systans  and  procedure  permit  the  cormander  to  do 
these  things.  First,  the  comander  and  his  staff  should  be  able 
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to  nake  estimates  of  opposing  force  capabilities  and  fron  these 
estimates  anticipate  situations  that  are  likely  to  arise.  Fran 
these  anticipaticns  and  estimates  the  catmander  must  be  able  to 
plan  actions  that  use  the  force  capability  available  to  him. 

The  success  of  the  catmander  will  also  be  affected  by  his  ability 
to  control  the  rate  and  intensity  of  conbat  according  to  his 
plans.  The  catmander  should  be  able  to  control  novement  and  alert 
status  of  the  forces.  It  should  also  be  possible  to  examine  hew 
much  better  the  forces  function  vhen  the  catmander  is  provided 
with  better  or  more  timely  information.  In  addition,  the  can- 
mander  will  want  to  manage  supply  and  maintenance  and  protect 
those  functions  from  destruction  or  disruption. 

f!  In  the  past,  when  evaluating  new  systems,  the  philosophy  of 

the  analyst  and  R&D  manager  has  been  that  goals  are  achieved 

f,  vhen  information  is  provided  and  contiunications  are  available. 

When  conducting  analyses  of  campaigns  a basic  assrrption  is 
I usually  that  the  cormander  has  perfect  information.  These  con- 

I ' ditions  do  not  allow  for  either  the  vagciries  of  human  performance 

^ or  of  the  battlefield.  This  means  that  it  would  be  desirable  to 

be  able  to  measure  the  c^jabilities  of  the  coimand  and  information 
I system  to  adapt  to  incoiplete  or  erroneous  information,  surprise, 

i and  unexpected  events.  The  coinHnder  should  also  be  able  to 

t 

1 exploit  opiportunities  or  errors  in  decision  no  natter  what  their 

cause. 

It  is  possible  to  imagine  a number  of  measures  of  performance, 
including  those  that  have  been  used  in  the  pjast  for  ccnmunications 
systans.  An  exanple  is  error  rate  or  delay.  The  final  measure, 
honever,  of  the  effectiveness  of  any  of  these  systans  will  be  in 
terms  of  combat  outcome,  friendly  force  survivability,  and  the 
ability  to  modify  and  adapt  plans  to  changing  situations.  In 
order  to  sanple  the  catplexity  of  the  situations  to  be  considered, 
a representation  of  a battlefield  situation  is  shown  in  Figure  1. 
The  illustration  is  presented  to  atphasize  the  time  and  space 
. relationshipjs.  Distance  from  the  FEBA  is  shown  on  the  horizontal 
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axis,  Red  on  one  side.  Blue  on  the  other,  and  time  on  the  vertical 
axis.  In  this  illustration  a regiment  is  represented  as  advancing 
on  the  right  with  armor  leading.  The  amor  stops  to  deploy  in 
battalion  formation  for  attack.  Air  defense  units  pass  through 
and  are  deployed  at  appropriate  locations.  Artillery  comes  up 
from  the  end  of  the  colvitin,  sets  up  and  initiates  preparatory 
fires.  The  arTX)r  units  advance  and  are  shown  to  be  leap-frogging 
on  the  attack.  On  the  Blue  side  a reconnaissance  force  with 
armor  is  at  the  most  advanced  position  and  at  some  point  the 
advance  of  the  attacker  is  detected.  The  deployment  of  the 
attacking  units  can  be  assumed  to  be  following  a definite  sequence 
of  events.  Some  events  are  precursors  of  others  so  that  the 
afpearance  of  the  air  defense  units,  for  exanple,  deploying  in  a 
certain  way  can  be  taken  as  indicators  of  caning  armor  or  artil- 
lery actions.  If  the  defending  ground  ccmnwnder  wishes  to  obtain 
air  suf^rt,  the  US  ccmnand  system  by  which  this  done  is  repre- 
sented in  Figure  2.  The  interaction  of  the  oaimand  system  of  the 
air  forces  and  the  ground  forces  is  indicated.  A request,  for 
exanple,  goes  from  the  forward  air  controller  to  the  Direct  Air 
Support  Center.  Lower  and  higher  levels  of  ccmrand  are  notified. 
Enroute  sorties  are  diverted  or  aircraft  are  scrambled  frcm  air- 
fields to  attack  the  attacking  ground  force.  These  activities, 
of  course,  have  to  be  coordinated  with  other  air  operations  such 
as  air  defense  and  with  the  activities  of  the  ground-to-air 
defense  systems.  These  activities  are  incorporated  into  the 
fabric  of  catmand  and  control  of  all  operations. 

Figure  3 presents  a sittplified  picture  of  the  coimand  struc- 
ture frcm  the  threater  cotmander  through  the  ground  coiponent 
catmander  and  the  air  ccmponent  cotmander.  As  indicated  in 
Figure  2,  there  is  information  transnitted  and  down  both  of 
the  air  and  ground  force  hierarchies  and  also  frcm  one  hierarchy 
to  another.  Information  sources  provide  input  to  the  levels  of 
catmand.  An  inportant  feature  to  note  is  that  there  is  a hier- 
archial  distributitai  of  information  systans,  that  is,  not  all 


sources  provide  informatioi  to  all  levels  of  ccrmand.  The  de- 
sired characteristics  of  the  means  to  analyze  tlese  systems  should 
include  the  ability  to  examine  the  effects  of  providing  different 
kinds  an!  amounts  of  information  to  the  different  levels  of  can- 
mand.  Representation  of  the  kinds  of  actions  taken  at  the  dif- 
ferent levels  of  cottnand  are  indicated.  For  purposes  of  discus- 
sion, the  coirand  hierarchy  can  be  further  simplified  to  three 
levels:  theater,  intermediate,  and  engaged  forces  (Figure  4). 

With  each  level  of  ccranand  it  seems  reasonable  to  identify  a 
number  of  functicmis  that  will  be  carried  out.  The  level  of  de- 
tail, kinds  of  information,  and  resulting  actions  at  each  level 
may  be  different,  but  it  is  suggested  that  the  basic  functions 
at  each  level  remain  the  same. 

In  a campaign  there  are  a wide  variety  of  events  occurring 
on  which  information  must  be  obtained.  These  events  include  the 
ccmbat  activities  of  both  the  friendly  and  the  enany  forces,  the 
status  of  forces,  the  needs  for  supply,  maintenance,  and  other 
housekeeping  chores.  Certain  sensors  provide  information  on  the 
events,  these  sensors  range  from  the  eyeball  of  the  individuals 
on  the  scene  to  scphisticated  electrcnic  sensors  (Figure  5) . The 
array  of  interactions  between  the  information  collection  means 
can  be  represeqted  in  a simple  2x2  matrix.  Along  the  tcp  are  A 
forces  and  B forces  and  on  the  side  A sensors  and  B sensors. 

The  B coimander  obtains  information  from  B sensors  on  both  A and 
B forces,  the  B comander  also  obtains  information  from  A sensors 
on  A and  B forces  through  captured  reports  and  electronic  intel- 
ligence means.  The  processes  by  which  information  is  made  avail- 
able to  a coimander  is  most  simply  represented  by  identifiable 
steps  of  collecticsi,  processing,  interpretation,  and  dissanina- 
tion.  It  is  important  to  emphasize  that  consideration  is  beir>3 
given  here  to  information  on  both  friendly  and  enemy  forces.  At 
the  beginning  of  this  discussion  one  of  the  asseiptions  was  that 
we  knew  how  to  model  sensor  systems.  The  modeling,  the  proces- 
sing and  interpretation  of  data  from  specific  sensors  has  also 
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been  successfully  accatplisN=»l  in  the  past.  Deficiencies  eirise, 
however,  when  the  attenpt  is  made  to  integrate  the  information 
collected  by  an  curray  or  package  of  sensors.  For  exanple,  a 
reconnaissance  aircraft  may  ccirry  photographic  equiprent,  IR, 
radar,  EUNT  sensors,  and  the  eyeball  of  the  pilot.  When  the 
aircraft  flies  over  enemy  territory  each  of  these  sensors  col- 
lects different  infomation  over  different  widths  of  territory. 
When  all  of  this  information  has  been  processed  and  interpreted 
it  must  be  transformed  so  that  the  caimander  to  whom  it  is  pre- 
sented is  informed  of  the  nature  and  character,  location,  and 
identity  of  units  and  weapons  at  a given  time.  The  ctojective  to 
be  achieved  frcm  the  infonnation  obtained  frcm  the  reconnaissance 
aircraft  and  all  other  sensor  systans  is  the  ccmstructicn  of  a 
situation  map  of  the  enemy  forces.  Since  the  informatioi  obtained 
will  be  inccnplete,  will  have  error,  and  will  have  been  collected 
at  different  times,  the  information  on  that  map  will  always  be 
erroneous  and  inccrplete.  Similarly,  the  cotmander  will  have  a 
map  of  the  friendly  forces  based  on  the  sensor  systems  by  vduch 
those  forces  are  observed.  This  nap  will  also  be  erroneous  and 
inccrplete  but  with  different  time  and  place  relationships.  In  a 
military  operaticsi  the  cotmander  will  examine  these  maps  and 
endeavor  to  perceive  the  situation  (Figxire  6) . If  he  is  irore 
cautious  he  may  delay  and  request  additional  information.  This 
will  take  time  eind  mean  that  the  orders  that  he  gives  will  result 
in  different  actions  and  thus  changes  in  effectiveness  of  those 
forces  under  his  ccrmand  vben  carrying  out  their  conbat  functions. 
One  of  the  problems  then  is  to  build  an  analytical  approach  for 
constructing  a representation  of  these  maps  that  is  responsive 
to  the  integrated  inputs  of  the  variety  of  scenarios  and  r^xcrt- 
ing  systans.  Most  likely  there  will  be  seme  prcbabilistic  repre- 
sentation of  the  identity  cind  location  of  units  cind  weapons  at  a 
time.  If  it  is  possible  to  postulate  that  there  is  a reasonable 
nuiber  of  situations  that  can  be  identified,  then  it  might  be 
possible  to  provide  a current  estimate  of  a situation  as  repre- 
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sented  by  the  scenario  inputs  by  caiparison  with  a set  of  likely 
situations.  The  basis  for  the  constructicai  of  reference  sets  of 
situations  is  that  military  units  have  recognizable  formations 
and  postures  associated  with  different  cperations.  It  might  be 
possible,  for  instance,  to  assign  a probability  distribution  to 
the  exercise  of  a situation.  A further  postulate  is  that  there 

I 

j are  a reasonable  nianber  of  expected  events  that  can  occur  at  a 

given  time  in  the  future.  Using  a sinple  exanple,  if  a unit  is 
moving  along  a road  it  may  be  presutved  that  after  a lapse  of  a 
certain  time,  that  the  unit  is  probably  located  a certain  distance 
I down  the  road  unless  other  actions  interfere.  It  might  thus  be 

1 possible  to  construct  an  estimate  of  anticipated  situations  with 

I a probabilistic  description  of  the  identity  and  location  of  units 

! and  weapons  at  a designated  time  in  the  future.  The  catmander 

will  wish  to  establish  a number  of  tentative  mission  plans  based 
on  those  current  and  anticipated  situation  maps  and  test  those 
plans  for  possible  gains  and  losses.  Within  a model  of  the  deci- 
sion processes  a suggestioi  has  been  made  that  part  of  tlie  plan-  i 

ning  activity  of  a conmander  could  be  represented  by  a sinple  and  i 

highly  aggregate  war  game.  The  game  would  be  played  to  establish  j 

alternative  outccmes,  gains,  ar«d  losses.  Fran  these  eiltematives  j 

; a model  might  use  simplified  linear  programs  or  game  theoretic 

techniques  to  assign  different  aircraft  to  tasks  or  to  establish 
frag  orders  on  the  missions  for  the  next  day.  This  output  of 
allotments  or  frag  orders  represents  the  actions  of  the  comiander. 

Within  a model,  the  representations  of  the  acticms  of  the 
ccntnand  system  could  appear  as  assignments,  allocations,  and  move- 
ments as  in  a theater  operation.  The  more  difficult  part  to 
simulate  is  the  modification  of  plans,  particularly  vrtien  situa- 
tions have  changed  sufficiently  that  significant  alteration  in 
cissigments  and  allocations  should  occur.  For  instance,  if  large 
forces  have  been  allocated  initially  to  the  achievanent  of  an 
objective  and  the  results  of  the  actions  have  been  only  partial 
achievanent  of  the  objective  with  great  cost,  how  is  it  possible 
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to  construct  a simulation  of  a reasonable  cotmand  such  that  new 
objectives  are  achieved?  One  possibility  includes  the  use  of 
threshold  criteria  within  feedback  loops. 

The  idea  that  the  comnand  process  is  a feedback  system  has 
arisen  before.  To  be  useful  for  the  examination  of  the  kinds  of 
problems  identified  at  the  c^sening  of  this  discussion,  the  feed- 
back system  would  necessarily  be  hierarchical  and  the  input  and 
response  characteristics  at  the  different  levels.  Figure  7 shews 
a representation  of  such  a system.  In  the  upper  comer  is  the 
ir^xit  of  the  initial  overall  campaign  plan  and  the  basic  policies 
and  doctrine  to  be  followed.  In  a model,  the  scenarios  and  objec- 
tives are  input  and  initial  orders  are  given  to  start  the  campaign. 
These  orders  are  passed  to  lower  levels  of  caimand,  through  the 
decision  makers  for  implementation  of  the  necessary  actions.  As 
a result  of  this,  certain  events  occur.  These  iiiclude  movements, 
attrition,  supply  daiand,  and  need  for  repair.  Information  on 
these  events  is  ctotained,  through  sensors  to  the  cotmands,  more 
information  may  be  requested,  and  the  new  situations  perceived. 

The  decision  makers  must  adapt  to  the  new  situations  and  issue 
new  orders  to  modify  plans  and  institute  new  actions. 

There  are  many  elements  of  this  concept  of  a model  of  a 
coimand-control- information  systan  that  are  speculative  and  which 
will  require  some  model  formulations  that  are,  at  least,  signifi- 
cantly different  fron  things  that  have  been  done  in  the  past. 
Alternative  formulations  and  new  ideas  are  needed.  It  would  be 
desirable  to  institute  a research  program  leading  to  the  con- 
struction of  an  experimental  model  to  test  and  evaluate  such  an 
analytic  approach  to  the  assessient  of  ccnmand-control-information 
I systans.  It  appears  that  the  problem  of  situation  perception  and 

[ transformation  through  decisionmaking  is  the  most  difficult  part 

! and  the  part  on  which  the  least  work  has  been  done.  New  percep- 

[ tions  and  suggestions  cire  earnestly  sought. 
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DECISION  SUPPORT  IN  A BATTLEFIELD  ENVIRONMENT 


by  DR.  JOHN  A.  MODRICK 
Si/6^cm4  and  Rziecuidi  Cznte-fi  Honeywell,  Inc. 


The  objective  of  this  paper  is  to  give  an  overview  of  seme 
wrk  we  have  done  on  decision  aiding  under  support  frem  the 
Army  Research  Institute.  This  work  was  reported  in  three  techni- 
cal reports  (Levit,  Alden,  Erickson  and  Heaton,  1974).  It  is 
also  an  extension  and  ajplication  of  prior  work  we  had  done  on 
decision  styles  (Henke,  Alden  and  Levit,  1972) . Although  a 
difficult  concept  to  work  with,  individual  differences  in  deci- 
sion making  and  information  is  a recurring  theme  in  the  literature 
of  both  decision  making  and  catinand  and  control. 

During  this  period  an  extensive  literature  review  was  con- 
ducted of  decisicai-ma)dng,  cognitive  styles,  decision-aiding,  and 
man-conputer  interaction.  This  review  was  greatly  benefited  by  a 
concurrent  project  of  setting  ip  a dedicated  cerputer  facility  to 
provide  us  the  capability  for  two-person  interactive  gaming. 
Initially  we  called  the  facility  the  Eten-Cemputer  Laiooratory; 
recently  we  changed  the  name  to  Cotmand  and  Control  Simulation 
Facility  to  reflect  current  trends  and  projects. 

The  term  "battlefield  environment"  in  the  title  is  perhaps  a 
little  misleading.  Vfe  have  been  working  with  the  Anty's  Division 
Tactical  Operatiais  Center  (DTOC) . The  DTOC  is  not  at  or  near  the 
frait  line  where  troops  and  weapons  are  in  line-of -sight  contact; 
it  is  typical  15-20  kms  behind  the  FEBA  (forward  edge  of  the 
battle  area)  vhere  it  is  not  inmediately  involved  in  the  melee  of 
armed  conflict.  The  functions  of  the  DTOC  are  to  acquire  and 
integrate  informatics  on  hostile  and  friendly  force  movement  in 
the  divisional  area,  make  plans  for  deployment  of  divisional 
resources,  and  monitor  the  execution  of  these  plans.  It  is  a 
decisicxi  situation  with  a heavy  flew  of  information,  periods  of 
rapid  change,  and  a requirement  for  rapid,  real-time  update  and 


response.  This  situaticn  is  markedly  different  for  one  of  nation-  ■ 

al  crisis  viiere  events  tend  to  move  more  slowly  and  there  is  more 
time  for  analysis  and  evaluation. 

The  topics  to  be  covered  in  this  paper  are  the  following: 

1 

• Related  aspects  of  future  tactical  decision  situations  i 

• Need  for  decision  aiding 

• Criteria  for  decision  aids  j 

Decision  support  system 

Decision  styles  and  adaptive  aiding  I 

• Application  to  SIMTOS 

In  addition,  seme  ccnclusicais  are  presented  about  the  state-of- 
the-art  and  methodology  in  decision  aiding  and  decision  styles. 

Related  Mpect  FutuAz  Tactical  Vzeii-Lon  S-ituatLoyii  The  cem- 

plexity,  speed,  range  and  fire  pewer  of  modem  weapon  systans  i 

have  had  a significant  impact  on  the  flew  of  events  and  the  com-  | 

plexity  of  tactical  decision  making.  Future  tactical  conditions 

can  be  characterized  as:  | 

• More  r^id  speed  of  engagement.  The  speeds  with  viiich  ' 

modem  military  vehicles  can  close  on  each  other  in  ap- 
proaching the  limits  of  human  response  time. 

• longer  range  of  detection.  The  sensitivity  and  diffe-  | 

rentiation  of  sensors  systans  has  provided  a capability  -j 

to  detect  enany  action  at  greatly  increased  ranges. 

The  number  of  things  that  can  be  detected  has  also  i 

increased. 

longer  range  of  engaganent.  Events  can  take  place  at 
ranges  far  exceeding  those  at  vdiich  direct  sensory  con- 
firmation can  be  retained.  Information  about  events  is 
obtained  in  symbolic,  transformed  or  encoded  form.  It 
is  thus  necessary  to  act  within  highly  abstract  repre- 
sentations of  the  tactical  situation. 

Increased  weaponry.  The  diversity,  range,  sp«ed  and 
pxwer  of  weapons  have  increased  to  provide  a multi- 
threat environment  and  multi-threat  response  capability. 


261 


• Increased  coiplexity  of  systans.  The  diversity  of 
systems;  multiplicity  of  sensors,  information  sources, 
and  displays;  the  use  of  advanced  electronics  and  data 
processing;  and  increasing  levels  of  automation  all 
ccmbines  to  provide  a ccrplexity  that  is  difficult  to 
conceptualize,  ccrprehend  and  manage. 

• Reduced  manning.  There  is  increasing  pressure  to  reduce 
TOnning,  not  because  we  know  how  to  eliminate  man  from 
systans  but  because  personnel  costs  are  accounting  for 
increasing  portion  of  costs  in  relatively  stable  budgets. 
This  trend  has  tended  to  work  in  c^)position  to  the 
increased  coiplexity  of  systans. 

The  conditions  lead  to  the  following  requiranents  for  deci- 
sion itaking  in  future  systans. 

• Decisions  process  must  be  conpleted  within  seconds. 

■ Initial  time  critical  steps  preprogranmed.  The  rates 
of  closure  of  modem  weapons  are  so  rapid  that  early 
detection  and  evaluation  are  critical.  Man's  variabil- 
ity in  such  tasks  cannot  be  tolerated.  Therefore,  seme 
preprograiming  and  autcration  are  necessary. 

• Man  must  process  in  parallel  to  the  systan  rather  than 
in  series  with  it.  He  must  be  able  to  follow  what  the 
systan  is  doing  and  assess  the  inpact  and  feasibility 
of  the  course  of  actions. 

• Man's  role  limited  to  final  step.  Man's  function  vd.ll 
be  primarily  one  of  selection  or  evaluation  of  action 
alternatives. 

Man  has  override  responsibility.  Cettmand  vd.ll  be  exer- 
cised by  exception  and  interceding  to  override  the 
course  of  events  that  the  conmander  judges  to  be  unde- 
sirable. 

Meed  ^0^  Ve.CAJi.ion  kidi  These  considerations  in  turn  define  data 
requirements  to  sipport  the  cemnand  and  control  process  in  future 
systems.  First,  timing  is  critical.  Information  must  be  provided 
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in  a timely  manner  in  a continuing,  dynamic,  rapidly  changing 
situation.  Second,  only  data  relevant  to  a decision  must  be  pre- 
sented. Finally,  data  must  be  iirmediately  interpretable.  The 
ccnmand  staff  does  not  have  time  to  do  any  transformation  or 
interpretation  of  uie  information  presented  to  it. 

The  process  of  decision  making,  especially  as  it  applies  to 
tactical  decision  making,  should  be  defined  to  facilitate  further 
discussion.  Tactical  decision  making  ccxisists  of  a sequence  of 
functions  and  typically  it  is  defined  by  differentiating  these 
functicxis.  Several  different  definitions  cure  in  the  literature; 
they  differentiate  the  process  in  slightly  different  ways. 

The  definition  presented  here  divides  the  process  into  five 
major  functions,  as  follows: 

. Information  collection 

- sorting 

- structuring 

. Problem  analysis 

- discover  relationship 

- analyze  risks 

- generation  options 

- evaluate  colons 

. Selection  of  action  alternative 

. Inplaientation  of  decision 


^fc>nitor  progress 
- monitor  feedback  on  events 


- recognize  changes 

- modify  decision 


override 


Although  there  is  a logical  teitporal  sequence,  the  functions 
are  in  fact  iterative  and  overlapping. 

The  need  for  decision  aiding  can  be  identified  from  the 
following  generalizations  about  decision  behavior,  taken  from 
Schrenk  (1969) . 


J 


Individual  differences  are  large.  The  variance  of  i 

measures  of  decision  behavior  is  typically  large.  There  j 

are  better  and  worse  decision  makers.  Selection  is  one  j 

way  to  reduce  this  variance.  Another  way  is  to  provide  i 

aiding  techniques  that  are  adaptive  to  these  individual  I 

differences.  It  is  postulated  that  the  variance 
reflects  differences  in  decision,  or  cognitive,  style. 

. Use  of  information  i 

I 

- excessive  information  is  often  sought  I 

- use  of  multi-dimensional  information  is  limited  j 

- early  information  is  given  excessive  weight  ; 

. Selection  of  action  alternatives  ' 

- too  few  alternatives  are  considered 

- ccrmitment  may  be  delayed  too  long  I 

- change  in  erroneous  comiitment  is  slew 

In  spite  of  all  these  shortccniings , the  decisions  made  are  gen- 
erally appropriate.  ] 

Cfiittnia  fiOH.  Vecci^on  Acdd  A set  of  desired  characteristics  of 

decision  aids  were  identified  to  guide  the  development  of  aids.  i 

These  characteristics  can  also  serve  as  criteria  against  vhich  \ 

an  aid  can  be  evaluated.  The  criteria  are  presented  here  under  ! 

three  headings:  pserformance,  workload  reduction  and  relational 
criteria. 

These  sets  of  criteria  are  as  folloira: 

PeA^o^unance.  C>uXiLfUa  ; 

. Iirproves  decision  quality  by  reducing  error,  decreasing  j 

decision  time 

. Generates,  classifies  and  weights  response  alternatives 
Provides  rapid  feedback  on  decision  cc»isequences 
. Helps  in  the  formulation  and  application  of  rules 
. Encourages  seeking  new  relationships  by  assisting  data- 
base restructuring 

. Anticipates  and  helps  prepare  for  contingencies  j 

. Aids  in  accepting  discrepiancies  between  expectations  and  j 


264 


the  real  world 
tilo>ikload  Reduction  C^uXe^Xa 

• Assist  user  to  discriminate  relevant  frcxn  irrelevant 
information  ' 

. Allocate  functions  between  man  and  ccrputer 
. Assist  parallel  information  processing 

. Aid  in  J^eeping  track  of  parallel  events 
KelationaZ  CfuXexia 

. Requires  a minimum  of  training  to  use 

Is  simple  to  ittplement  and  reliable  in  operation 
. Generates  confidence  and  trust  in  the  user 
. Encourages  interaction  with  autcrated  system 

Facilitates  camiunication  among  the  coimand  team 
. Responds  to  user  variability 

Pec-c6-roK  Suppoftt  Sifitem  a review  of  the  literature  on  decision 
aiding  and  an  analysis  of  tactical  decision  tasks  led  to  the  con- 
cept of  a Decision  Svpport  System  (DSS) . The  central  in  the 
DSS  is  to  provide  support  to  the  er  ' ire  decision  process  in  a 
given  situation.  An  integrated  ccrtple^c  of  decision  aids  is  pro- 
vided with  each  coiponent  aid  designed  to  satisfy  an  identified 
requirement.  A mixture  of  aiding  methods  is  used.  The  DSS  is 
treated  as  an  interactive  man-computer  unit. 

An  important  element  of  the  concept  is  that  the  aids  within 
a DSS  will  support,  or  aid,  human  information  processing.  There 
are  points  in  the  decision-making  process  where  human  c^ability 
is  inadequate  because  of  limitations,  variability  or  tendencies 
to  make  errors.  The  aid  would  provide  support  at  these  points, 
'■lie  alternative  to  this  approach  is  to  design  the  aid  or  decision 
support  systan  to  solve  the  decision  problem  and  supplant  man  or 
put  man  in  a position  of  supporting  the  decision  system.  This 
letter  approach  is  rejected.  Man  has  the  priitary  position. 

Three  classes  of  aids  were  identified  for  inclusion  in  a 
decisicai  support  system: 
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. Estimate  of  situation  - Information  to  structure  and 
interpret  the  tactical  problan 

. Resource  allocation  - Information  and  ccrinunication 
for  systematic  and  optimal  allocation  of  resources 

. Contingency  planning  - Assess  consequences  of  alterna- 
tive actions;  play  "what  if" 

Vecci^on  StLilu  and  Adafxtive  Adding  The  idea  of  the  decision 
style  is  basis  of  our  approach  to  making  aids  adaptive  to 
individual  differences.  The  terms  decision  style  and  cognitive 
style  will  be  used  somewhat  interchangeably. 

The  relevant  literature  is  voluminous  and  heterogeneous.  Pcur- 
ticular  investigators,  or  groups  of  investigators,  have  pursued 
studies  relevant  to  a single  dimension  of  style  but  there  has  been 
little  integration  of  these  dimensions  into  global  concept  of 
cognitive  style. 

Intensive  examination  of  the  literature,  hcwever,  revealed 
that  most  of  the  studies  could  be  groiped  under  three  categories: 
abstract-concrete;  logical-intuitive,  and  active-passive.  These 
categories  were  ac^xjced  as  independent  dimensions  of  cognitive 
style.  The  selection  of  these  dimensicsis  was  dcxie  by  a process 
of  "verbal-conceptual  eyeballing"  of  the  literature  rather  than 
enpirical  methods  such  as  cluster  or  factor  analysis.  Direct 
atpirical  sipport  is  desirable  but  it  was  not  attainable  with  the 
resources  available.  The  present  model  is  presented  as  a first 
approximation  which  was  formulated  as  an  aid  in  structuring  the 
design  of  decision  aids. 

Each  style  dimension  is  associated  with  a dimension  of  infor- 
maticxi  and  an  ai^ject  of  decisicm  naking,  as  follows: 
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style  Ditnensicm 


Abstract-Oantrete 


Log  ical-  Intiaitive 


Dimensicai  of  Infor- 
maticm  Processing 

Type  of  Information 
used 


Aspect  of  Deci- 
sion  Making 

Information 

Acquisition 

Information 

Assimilation 


Action  selection 


Form  of  infomation 
processing 

Active-Passive  Activity  level  in  in- 

formation acquisition- 
processing 

Each  style  was  also  hypothesized  to  have  a form  or  format  of 
information  presentation  associated  with  it. 

Style  Type  Information  Presentation  Correlate 

Abstract  Symbolic 

Concrete  Liguistic 


Logical 

Intuitive 


Structured  Data 
Global  Associative  Data 


Active  Partial  Data  Array 

Passive  Ccttplete  Data  Array 

Each  dimension  of  decision  style  was  differentiated  into  bdiav- 
ioral  correlates.  They  were  based  on  catmon  findings  in  the 
resecuch  literature.  Much  of  the  terminology  has  standardized 
meaning  in  the  psychological  literature  which  does  not  alvays 
oorrespond  to  the  everyday  usage.  These  behavioral  correlates 
are  summarized  below  for  each  dimension. 

Abstract  Traits  Concrete  Traits 


1. 

Field  independence 

1. 

Field  dependence 

2. 

Objective 

2. 

Subjective 

3. 

Control  over  inpulses 

3. 

Less  control  over  inpulses 

4. 

Synfcolic 

4. 

Linguistic 

5. 

Visual! zer 
(non-^nanipulative) 

5. 

Non-visualizer 
(manipulative ) 

6. 

Tolerance  for  ambiguity 

6. 

No  tolerance  for  ambiguity 

7. 

Ability  to  change  set 

7. 

Less  ability  to  change  set 

8. 

Open  mind 

8. 

Closed  mind 
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tical  Traits 

Intuitive  Traits 

1. 

High  information  demand 

1. 

Low  information  demand 

2. 

Caution 

2. 

Confidence 

3. 

Seeks  order  and  regularity 

3. 

Less  order  and  regularity 

4. 

High  need  achievement 

4. 

Low  need  achievement 

5. 

High  fear  of  failure 

5. 

Low  fear  of  failure 

6. 

High  anxiety 

6. 

Lew  anxiety 

7. 

Analyzer 

7. 

Synthesizer 

8. 

Sharpener 

8. 

Leveler 

9. 

Narrow  categorizer 

9. 

Broad  categorizer 

10. 

Global 

Active  Traits 

Passive  Traits 

1. 

Mental  alertness 

1. 

Mental  slowness 

2. 

Seeks  to  increase  activity 
level 

2. 

Seeks  to  reduce  activity 
level 

3. 

High  need  for  novelty 

3. 

Prefers  status  quo 

4. 

Seeks  imcertainty 

4. 

Desires  certainty 

5. 

Manipulative 

5. 

Seeks  internal  stimulation 

6. 

Seeks  external  stimulation 

6. 

Seeks  intensity 

7. 

Seeks  meaningfulness 

7. 

Needs  organization 

8. 

Needs  less  organization 

8. 

Tendency  to  introvert 

9. 

Tendencies  to  extrovert 

9. 

Long  attention  span 

10. 

Short  attention  span 

Each  of  the  three  style  dimensions  was  treated  as  a dicho- 
tomy and  this  decisiai  yielded  eight  different  decision  types 
into  viiich  pec^le  can  be  classified.  Each  decision  type  was 
assimed  to  have  characteristic  errors  or  aberrations  of  informa- 
tion processing;  a good  decision  aid  would  corpensate  for  or  buf- 
fer these  errors  and  abberrations.  Similarly,  the  individuals 
in  a given  type  will  have  preferred  ways  of  operating  vrfiich  the 
aid  should  acccmnodate. 


A paper  and  pencil  measuring  device  was  developed  to  give  a 
score  on  each  of  the  eight  "poles"  of  decision  style.  The  device 
is  called  the  DecisiOTi  Styles  Measuring  Instnment  (DSMI) . It 
consists  of  several  situational  scenarios  about  which  the  respon- 
dent must  choose  as  he  would  proceed  in  the  situation.  The  DEMI 
was  designed  for  administration  in  one  hour  for  ease  of  incorpo- 
ration in  experinental  procedures.  Further  details  on  the  DSMI 
may  be  found  in  (Levit,  Alden,  Erickson  and  Heaton,  1974,  Vol.  2). 

Representative  tactical  decision  profiles  were  developed  for 
each  of  the  eight  types.  The  profile  for  active,  abstract,  logi- 
cal is  surmarized  belcw  as  an  illustration. 

1.  Functicais  best  with  a broad  range  of  information 

2.  Information  should  have  inherent  structure,  easily 
defined  and  constant 

3.  Requires  concise,  accurate  display  of  information  vAiich 
will  confirm  his  concept  of  the  sutuation 

4.  Level  of  detail  need  not  be  great 

5.  Plans  problan  around  his  concept  of  situation 

6.  Will  query  data  base  selectivity  to  assess  adequacy  of 
his  plan 

7.  Will  not  need  overall  review  of  situation;  will  depend 
on  his  ejq«rience  in  similar  situations 

8.  Crucial  to  give  him  information  that  might  cause  him  to 
change  2iis  e;q»ctancies 

9.  Data  in  disagreement  with  his  approach  must  be  atphasized 

10.  Must  be  encouraged  to  constantly  re-evaluate  his  plan 

Note  that  items  1-6  are  descriptive  of  a itcde  of  operation  and 
preferences;  items  7-10  deal  with  shortcanings  which  must  be 
[ counter-acted. 

I The  tactical  decisicn  prefile  for  active,  concrete,  intuitive 

j;  is  much  briefier. 

L . Will  saitple  the  data  base  in  great  depth,  across  a 

[ ! broad  range  of  topics. 
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. Will  benefit  fron  any  device  that  would  help  him  cor- 
relate data  across  categories  of  information 

. Tends  toward  rigidity  after  he  has  developed  his 
approach  to  the  situation 

. Will  change  his  approach  if  presented  with  the  appro- 
priate facts 

Application  to  SIMTOS  The  <±)jective  of  this  study  was  to  evaluate 
adaptive  decision  aids  that  had  been  designed  and  incorporated 
into  the  SIMTOS.  SIMTOS  is  a simulated  tactical  (^ration  systan 
at  the  Army  Research  Institute.  The  scenario  used  was  set  in  a 
European  environment  and  consisted  of  a defense  of  the  Hof  Gap 
area.  Both  planning  and  conbat  phases  were  included.  The  aids 
were  designed  to  sv^jport  the  Division  Operations  Officer  (G3) . 

The  study  turned  out  to  be  more  exploratory  than  hypothesis 
testing.  It  was  intended  to  be  a rigorous  experimental  evalua- 
tion. However,  the  cotplexity  of  the  problatc  of  incorporating 
the  aids  into  the  SIMTOS  scenario  precluded  achieving  that 
objective  within  the  available  time. 

Two  aids  were  designed:  estimate  of  the  situation  and 
resource  allocation.  The  situational  estimate  aid  consisted  of 
an  autcmatic  tracking  and  updating  of  elanents  of  information 
designated  by  the  G-3.  The  designated  elanents  are  called  Stan- 
dard Requests  for  Information  (SRI) . Each  SRI  is  automatically 
updated  and  displayed  to  the  G3.  The  SRI  is  an  aid  to  recognizing 
or  attending  to  changes  in  key  elanents  in  the  ccmbat  situation. 

A iTBximum  of  30  SRIs  were  available.  The  resource  allocation  aid 
consisted  of  a display  of  all  friendly  units  within  range  of  a 
designated  target  and  the  available  fire  power. 

TWD  groips  were  run;  they  differed  in  the  decision  aiding 
provided,  as  follows: 

Aided  Group 

. Planning  phase 

- Estimate  of  situation 


Ccmbat  phase  aids 

- Estimate  of  situation 

- Resource  allocation 


Unaided  Group 
. Ccmbat  phase  aid 

- Rescurce  allocatioi 

The  resource  allocation  aid  was  provided  to  both  groups  in  order 
to  reduce  the  ccnplexity  of  the  experimental  task.  Fire  sufport 
is  not  a part  of  the  G3  role  and  he  does  not  have  the  facilities 
to  perform  that  task.  There  were  ten  participants  in  the  study 
ranging  in  rank  frcm  Major  to  Colonel.  Nine,  one-hour  sessions 
were  run. 

Several  performance  measures  were  collected.  They  are  sum- 
marized below  in  tws  categories  of  Informaticai  Processing  and 
Tactical  measures. 


Information  Processing 

1.  Sources  sought 

2 . Action  ratio 

3.  Error  ratio 

4 . Redundancy  ratio 

5.  Information  acquisition  ratio 

6.  Resource  allocation  \jsage  efficency 

7.  Firing  time 

Tactical 

1.  Defensive  plans 

2.  Friendly  force  attrition 

3.  Enen^  force  attrition 

4 . Distance  surrendered 

5.  Friendly  force  weapon  ej^nditure 

6.  Events 


7.  Enemy  force  objectives  reached 


The  results  are  extensive  and  only  a representative  saitple 
will  be  presented  here.  Inferential  statistical  analysis  was 
limited  due  to  the  small  number  of  subjects.  Performance  of  the 
aided  and  unaided  groips  on  distance  surrendered  weapon  experxii- 
ture  and  friendly  force  attrition  is  presented  in  Figures  1,  2, 
and  3.  The  performance  of  the  aided  group  was  slightly  superior. 
Concliiiiotu,  In  general,  the  concepts  of  adaptive  decision  aiding 
and  the  decision  support  system  have  been  formualted  and  there  is 
weak  sijppoirt  for  the  usefulness  of  aiding,  the  concept  of  a deci- 
sion support  systan  and  aiding  adaptive  to  decision  style.  The 
mcdel  of  decision  styles  has  been  formulated  to  the  point  where  it 
can  be  stated  more  rigorously  and  hypotheses  can  be  generated  and 
tested. 

There  are  also  several  significant  problems  that  can  be  iden- 
tified. First,  at  the  current  state  of  the  art,  aiding  is  appli- 
catican  specific;  it  is  difficult  to  formulate  general  principles. 
Second,  data  base  structure  is  critical  to  useful  aiding.  The 
accessability  and  manipulability  of  the  data  is  important  to  deci- 
sion aiding  and  they  are  dep>endent  on  the  data  base  structure. 
Third,  the  research  and  develcpment  process  is  very  time  consuming. 
Large  quantities  of  data  are  collected  at  great  expense  but  with  a 
decreasing  yield  of  information  pier  cost.  Finally,  current 
research  methodology  and  tasks  in  decision-making  are  too  simple 
to  provide  anything  substantial  in  generalizations  to  tactical 
decision-making.  In  addition,  the  absence  of  itodels  of  the  tacti- 
cal decision  process  make  it  difficult  to  apply  research  findings 
to  this  context. 
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DISCUSSION 


Dockery:  I would  like  to  ask  Dr.  Modrick  a question.  It  appears 
that  vihat  you  are  saying  is  that  Caimand  and  Control  is  not  picking 
up  a mike  and  saying  the  mike  is  dead.  Rather  they  are  trying  to 
push  scmething  psychic  through  a wire  and  get  it  back.  In  your 
test  I would  like  to  know  - did  you  end  up  with  some  profile?  In 
other  words,  las  the  Military  System  empirically  made  some  match 
between  our  catmunication  systan  and  the  kinds  of  officers  they 
selected  at  various  levels?  In  other  words,  did  they  come  up  with 
some  sharp  profile  that  was  repeated  more  often  than  not?  There 
are  eight  combinatiois  - did  one  appear  more  often  than  the  others? 
Modrick:  I am  reluctant  to  respond  to  that  question  because  I am 
going  on  manory.  I think  on  this  level  the  doninant  profile  was 
active  abstract  intuitive,  ly  manory  was  inconplete.  Thirty  per- 
cent were  active/abstract/intuitive  and  forty  percent  were  passive/ 
abstract/logical.  Looking  at  each  dimension,  they  were  split 
evenly  on  active-passive  and  logical-intuitive  but  90%  were  abst- 
ract rather  than  concrete.  I would  have  to  do  some  thinking  new 
to  say  what  that  profile  represents.  They  were  an  impressive 
bunch  of  people,  incidentally.  Recently  we  had  the  opportunity 
to  administer  this  to  six  Captains,  wiiich  is  a very  anall  sample. 
The  Captains  liave  very  different  profiles.  They  had  a charac- 
teristic profile,  but  it  was  different  from  the  Major  or  Colonel 
type.  I don't  recall  off  hand  what  this  designated,  but  I do 
recall  that  it  was  different.  There  was  one  officer,  a Captain, 
who  had  a profile  like  the  Major  and  Colonel.  He  seemed  to  be  in 
a lot  of  ways  the  sharpest.  There  was  something  about  him  that  was 
different,  there  is  no  question  about  that.  I got  to  knew  these 
men  before  we  gave  than  the  test. 

Orlansky:  Assuming  that  this  structure  of  eight  different  types 
is  true  and  assuming  that  generally  you  find  it  out  about  people 
and  assuning  that  it  is  not  situationally  dependent.  What  would 
any  of  this  have  to  do  wdth  the  design  of  a Cemnand  and  Control 
systan? 
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Modrick:  Ihe  assunptions  are  perfectly  acceptable.  The  things 
are  stable,  I have  no  doubt  about  that.  What  does  it  mean  to  a 
catmand  and  control  system:  It  means  a lot  of  things.  It  says  a 
great  deal  about  hew  you  put  together  an  information  systan.  For 
one  thing,  it  is  dependent  on  vho  the  user  of  the  information  is. 

I think  this  is  a good  bit  of  ccMiitvon  sense  as  a matter  of  fact. 

One  of  the  stories  I have  heard  repeatedly  concerns  what  happens 
vhen  there  is  a change  in  catmand?  A new  man  comes  in  and  you 
certainly  will  notice  within  a year  there  is  a vexry  big  change  in 
personnel  in  the  Catmand  Headquarters.  The  staff  changes.  I 
think  he  picks  the  rtan  vho  fits  his  style.  I think  every  time  the 
Command  changes  there  is  one  man  vho  doesn't  fit  the  Gotmander's 
style  and  there  is  a conflict  between  than  and  that  man  goes. 

There  is  usually  some  ill  feelings.  But  within  a year  the  new 
commander  has  got  things  organized  the  way  he  likes  to  v«rk.  This 
is  also  vhat  I think  is  Command  pierogative  on  the  part  of  the 
Commemder.  I have  heard  Cotmanders  say,  "By  God,  as  long  as  I am 
Commander  you  are  going  to  do  things  my  way.” 

There  has  been  one  demonstration  that  I know  of  vhere  this 
nakes  a difference.  Gordon  Pask  in  England  has  worked  on  what  he 
calls  "learning  styles".  He  has  identified  two  kinds  of  learning 
styles.  It  is  very  difficult  to  show  substantial  differences  in 
decision  aiding.  What  Gordon  Pask  does,  he  sets  up  a person  with 
the  wnrong  type  of  style.  He  takes  a Type  "B"  individual  and  pro- 
grams Type  "A"  for  him  and  vice  versa.  Those  guys  just  have  one 
hell  of  a time.  I think  it  has  a great  deal  to  say  about  software, 
how  you  organize  the  data  base,  what  kind  of  display  you  use. 

Major  Franklin:  Let  me  subtdt  sonething  to  you.  It  is  more  of  a 
statement  to  hit  the  impiact  heavily.  We  are  currently  in  the  pro- 
cess where  we  select  cotmanders  by  a Catmand  Selection  Board. 

There  is  a sterotypae  typical  of  the  officer  that  fits  what  that 
board  feels  to  be  the  appropriate  career  pattern  for  Catmand 
Selection.  I am  going  to  put  out  to  ycu  as  an  operator  that  you 
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have  a given  and  it  is  a personality  make-up  that  ycxi  want  design 
to.  I think  sir,  that  you  will  identify  this.  I think  you  have 
seen  the  result  of  this.  This  is  one  of  the  things  you,  as 
researchers,  are  going  to  have  to  use  a given  parameter  to  work 
against.  There  are  a lot  of  things  that  are  going  to  impact  this 
heavily,  but  that  one  man,  the  type  of  iran  who  works  for  the 
battalion  Ccmiand  or  squadron  Ccninand.  His  personality  does 
iit^jact  heavily  and  it  is  a given. 
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NEW  APPROACHES  TO  DECISION  AIDING 
FOR  A NAVAL  TASK  FORCE  COMMANDER 

by  DR.  MARTIN  A.  TOLOOTT 
OlSij^ce  oi  Naval  Rue.a/ich 


Traditicaially,  the  design  of  a conmand  and  control  system 
involves  a series  of  veil  established  procedures.  First,  a set 
of  scenarios  is  generated,  intended  to  represent  the  range  of 
situations  or  contingencies  in  which  the  system  is  expected  to 
function.  Then,  experienced  military  officers  are  asked  to 
specify  what  information  they  would  need  in  order  to  operate 
effectively  - that  is,  to  make  decisions  effectively  - under  those 
warfare  situaticns.  Often,  they  are  asked  to  prioritize  the  in- 
formation, and  to  specify  sane  of  the  desired  characteristics  of 
each  item,  such  as  its  tolerable  delay  time,  its  required  accuracy, 
the  form  in  which  it  should  be  displayed,  etc.  These  data  are 
then  organized  and  sumnarized,  discrepancies  among  the  respondents 
are  resolved  through  additional  interviews  or  groip  discussions, 
and  the  resulting  data  are  taken  as  tlie  information  requirements 
on  vhich  to  base  the  system  design.  When  coiprcsnises  must  be  made 
due  to  limitation  of  equipment  weight,  spiace,  cost  or  expected 
capability,  they  are  based  on  the  expressed  priorities.  Admittedly, 
this  description  is  over-sinplified,  but  it  essentially  describes 
how  the  information  requirements  are  usually  determined. 

One  of  the  probl  :ms  with  this  approach  is  that  there  is  likely 
to  be  a lag  of  5-10  years  fron  the  time  requiranents  are  estab- 
lished until  a system  becoies  operational.  During  that  time  many 
changes  can  occur,  the  most  significant  being,  first,  the  emer- 
gence of  new  and  unanticipated  scenarios  or  contingencies,  and 
second,  the  assignment  of  new  personnel  - new  decision  makers  - 
with  their  own  individual  styles  and  priorities  of  information. 
Typically,  ccnmand  and  control  systems  lack  the  flexibility  to 
adapt  to  these  changes. 
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I will  describe  an  Office  of  Naval  Research  project.  Opera- 
tional Decision  Aids,  which  attempts  to  provide  this  flexibility. 
It  focuses  on  the  decision  process  itself,  and  develops  means 
whereby  this  process  can  be  facilitated  by  techniques  vdiich  take 
advantage  of  the  experienced  judgment  of  key  decision  makers  in 
their  actual  operating  situation  . Although  the  project  deals 
specifically  with  decisions  made  at  the  Navy  Task  Force  Contiand 
level,  the  techniques  being  developed  are  potentially  applicable 
to  comand/oontrol  systems  at  other  levels  as  well.  These  tech- 
niques are  expected  to  provide  the  flexibility  needed  to  deal 
with  unanticipated  and  widely  varied  contingencies  requiring  deci- 
sions to  be  made  quickly,  at  sea,  with  inperfect  or  inoonplete 
information;  many  of  these  decisions  will  have  significant  poli- 
tical implications.  In  line  with  this  objective  the  Operational 
Decision  Aids  project  is  not  attatpting  to  determine  information 
requirements  for  any  specific  system,  but  rather  to  develop  and 
evaluate  procedures  for  making  most  effective  use  of  information 
already  available  - includirig  the  idgments  of  experienced  offi- 
cers. If  the  techniques  work,  the^  will  help  overcane  seme  of  the 
known  human  limitations  in  dealing  with  high  information  loads. 
These  limitations  include  faulty  maiory,  stubbornness  about  hypo- 
theses even  in  the  face  of  conflicting  informaticn,  limited  cem- 
putational  ability,  rose-colored  hindsight  (that  is,  a tendency 
to  remember  past  decisions  as  invariably  correct) , and  narrowed 
focus  under  stress  (that  is,  a tendency  under  stress  to  ignore 
infometion  about  low  probability  threats  and  to  rely  on  habitual 
responses) . 

Our  approach  is  to  apply  advanced  technologies  vhich  have 
emerged  from  research  in  four  scientific  areas  in  ONR  - decision 
analysis,  coiputer  science,  operations  research  and  organizational 
analysis.  These  technologies  have  all  advanced  far  enough  to  have 
proven  effective  in  certain  limited  applications.  We  are  asking 
the  question:  can  they  bae  tailored  to  facilitate  decision  making 
in  operational  cemmand  and  control  systans?  I will  describe 
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briefly  the  concepts  being  ejqjlored  in  each  of  these  areas. 


Decision  analysis  is  a formal  procedure  for  structuring  or 
nodeling  a oorplex  decisicm  problan  into  its  ccrponent  parts 
(which  include  choice  points,  chance  events,  and  outcones) , 
eliciting  judgments  of  experienced  or  cognizant  individuals  regar- 
ding their  preferences  or  utilities  for  the  various  outcones  and 
their  estimates  of  the  likelihoods  or  probabilities  of  the  chance 
events,  and  applying  statistical  rules  for  conputing  the  expected 
value  of  each  alternative  choice.  It  is  usually  assumed  that  tte 
decision  maker  wishes  to  maximize  his  expected  value,  although 
this  need  not  be  the  case.  He  might,  for  exaitple,  want  to  mini- 
mize his  maximum  loss.  The  results  of  the  analysis  cam  then  be 
displayed  in  various  ways,  to  indicate,  for  exanple,  hew  sensitive 
the  results  are  to  errors  or  changes  of  judgment,  or  how  the  like- 
lihood of  each  possible  threat  cendition  changes  as  new  diagnostic 
informaticai  is  received,  or  vhen  the  threshold  for  a change  of 
decision  has  been  reached.  I will  not  go  into  the  details  of  this 
technique,  since  Dr.  Kelly  will  describe  it  in  a subsequent  talk. 
Hewever,  I would  like  to  make  the  following  points: 

1.  Decision  analysis  procedures  have  been  used  with  various 
degrees  of  success  in  many  one-of-a-kind  decision  problems  (such 
as  evaluaticxi  of  intelligence  data,  system  procuranent  decisions, 
and  develcpment  of  decision  rules  for  crisis  situations) . How- 
ever, it  is  still  a matter  of  controversy  as  to  vdiether  they  will 
prove  effective  for  Navy  tactical  decision  making.  Where  they 
have  been  successful,  they  have  required  the  presence  of  a deci- 
sicsi  analyst  to  help  structure  the  problan  cind  elicit  judgments. 

We  don't  yet  knew  vdiether  the  procedures  can  be  progranmed  into  a 
cenputer  and  carried  out  effectively  by  means  of  interactions 
between  the  catmand  staff  and  the  coiputer,  and  if  they  can,  how 
long  they  will  take  and  hew  much  training  will  be  necesscury.  We 
intend  to  answer  these  questions  experimentally. 

2.  The  triangle  display  which  Dr.  Kelley  will  describe  is 
just  one  concept  for  displaying  the  iiiplications  of  the  cermander' s 
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judgments.  We  are  investigating  several  alternative  concepts, 
including  one  which  displays  risk. 

3.  Our  objective  is  to  provide  an  adaptable  tool  for  Task 
Force  Comtianders.  To  the  extent  that  these  procedures  ittpede 
rapid  and  flexible  decision  making,  they  will  have  failed  to 
satisfy  an  essential  criterion  for  tactical  decision  making, 
although  they  might  still  be  valuable  for  other  types  of  C 
systems. 

4.  It  may  turn  out  that  decision  analysis  is  most  useful  as 
a training  tool  and  as  an  aid  in  tactical  planning.  In  those 
contexts  it  can  help  make  coimanders  aware  of  the  relative  con- 
tributicxis  of  Vcurious  diagnostic  indicators  in  making  inferences 
about  a situation,  and  of  the  relationships  between  situation 
assessnent,  risk  attitude,  and  action  selection. 

The  second  area  of  technology  contributing  to  this  program 
is  that  of  information  systems  or  ccnputer  science.  Here  we  are 
interested  nainly  in  data  base  management  systems  vrfiich  can  adapt 
to  particular  styles  or  preferences  of  individual  users,  and  in 
sinplified  methods  for  people  to  catmunicate  with  the  data  base 
in  both  directions  - that  is,  to  insert  requests  for  information, 
new  instructions,  and  estimates  or  judgments  to  be  used  as  data, 
and  to  receive  effectively  displayed  representations  of  the  cur- 
rent situation,  warnings  of  predicted  dangers,  information  trig- 
gers or  alerters,  and  other  data  relationships  as  desired.  The 
University  of  Pennsylvania  is  developing  a system  known  as  DAISY 
(Decision  Aiding  Information  System)  vdiich  embodies  these  features. 
It  can  keep  track  of  the  requests  and  decisions  made  by  a parti- 
cular user,  call  his  attention  to  subsequent  decision  situations 
which  are  similar  in  nature,  remind  him  of  the  information  he 
requested  and  the  decisiois  he  made  in  previous  instances,  thus 
jogging  his  memory.  It  allows  him  to  set  alerting  mechanians  for 
information  he  ccxisiders  especially  critical  in  a given  situation, 
and  to  remove  them  at  will.  It  allows  him  to  set  triggers  for 
decisions  he  wishes  to  inplement  as  soon  as  certain  information  is 
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received.  And,  it  recognizes  that,  in  general,  90%  of  requests 
are  for  only  10%  of  the  stored  data  - but  a different  10%  by 
different  users;  utility  files  adaptively  reorganize  thanselves 
to  particular  user  requests,  making  the  most  wanted  data  most 
easily  accessJale. 

The  DAISY  system  is  the  furthest  along  in  the  program,  and 
efforts  are  now  underway  to  transfer  sane  of  these  techniques  to 
the  Tactical  Flag  Caimand  Center  (TFCC)  program  currently  under 
development  by  the  Naval  Electronic  Systans  Camand. 

The  third  technology  area  being  drawn  upon  in  this  prograni 
is  that  of  operations  research  or  systems  analysis.  These  tech- 
niques have  in  the  past  contributed  methods  for  creating  tactical 
models  for  a variety  of  purposes  such  as  weapons  or  tactics  eval- 
uation, exercise  reconstruction,  war  game  assessments  and  the  like. 
The  idea  here  is  that,  with  certain  modifications,  models  such  as 
these  might  provide  a tactical  ccmmander  with  rapid  estimates  of 
the  relative  worth  or  outccme  of  several  alternative  tactics 
vrfiich  he  may  be  considering.  To  take  an  oversinplified  exanple, 
if  his  objective  is  to  lay  out  a course  for  a task  force  to  tran- 
sit from  point  A to  point  B,  through  an  area  with  enemy  threats 
in  unknown  but  estimated  positions,  algorithms  can  be  created  to 
corpute  desired  outccme  criteria  such  as  transit  time  and  degree 
of  vulnerability.  If  at  sore  time  an  enen^  submarine  (for  exanple) 
is  sighted,  new  probability  detection  contours  are  ccrputed  and 
displayed,  and  the  task  force  ccrmander  can  quickly  plot  several 
alternative  transit  courses,  and  have  ccrputed  and  displayed  the 
new  values  for  transit  time  and  vulnerability,  so  that  he  can 
make  his  own  trade  off  in  selecting  a new  course.  Outccme  cal- 
culators such  as  this  (but  much  more  detailed)  are  new  Iseing 
develcped  for  air  warfare  operations  and  for  electronic  emission 
control  tactics,  both  of  v*ich  involve  more  variables  related  to 
own  and  eneity  forces  than  can  easily  be  dealt  with  mentally  or  on 
a scratch  pad.  The  main  challenges  in  developing  this  type  of 
decision  aid  are: 
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1.  To  itBke  sure  that  the  models  are  detailed  enough  to  help 
solve  real  tactical  c^Jtion  problems,  yet  not  too  detailed  to  be 
irrelevant  to  task  force  ccmnand  level  decisions; 

2.  To  ensure  that  the  ccrmander  can  insert  his  own  approxi- 
mations as  to  the  tactical  situation  vAien  appropriate,  arvd  quickly 
rule  out  certain  obviously  undersirable  tactics,  in  order  to 
enable  the  models  to  be  structurally  simple  and  functionally 
rapid. 

This  work  on  man-aided  algorithmic  solutions  is  not  as  far 
along  as  the  other  two  areas  described  earlier. 

Finally,  a small  part  of  the  total  effort  is  investigating 
the  area  of  organizational  analysis  in  the  context  of  ccitputer- 
based  information  systems.  There  is  at  least  anecdotal  evidence 
that  the  introduction  of  ccitputer-based  systans  into  organizations 
usually  creates  the  need  for  reallocation  of  functions  and  corre- 
^nding  re-structuring  of  the  group  in  order  to  take  best  advan- 
tage of  the  new  technology.  Indeed,  it  is  often  the  case  that 
resistance  aroused  by  the  new  systems  and  procedures  seriously 
interferes  with  the  realization  of  the  potential  benefits.  Con- 
sequently, we  are  reviewing  both  the  scientific  literature  in 
organizational  theory,  and  the  actual  instances  in  vhich  such 
systans  have  been  introduced  into  military  and  industrial  organ- 
izations. We  are  trying  to  identify  any  cotmon  patterns  of 
organizational  change  vhich  can  provide  guidelines  as  to  desir- 
able reallocation  of  team  functions  for  future  consideration  in 
ccrtmand  and  control. 

In  suntnary,  we  are  not  trying  to  design  a new  system.  We 
are  trying  to  exploit  certain  technological  developments,  tailor 
thorn  to  specific  cotmand  and  control  purposes,  and  evaluate  their 
potential  effectiveness  as  aids  to  the  decision  process. 

These  techniques  are  designed  to  aid  the  decision  maker 
rather  than  to  autcmate  the  decisions.  They  make  use  of  the 
uncertainty  inherent  in  the  situation  by  making  it  explicit  - in 
the  form  of  judged  probabilities  - and  treating  these  probabili- 
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ties  as  data,  rather  than  ignoring  them.  They  provide  aids  to 
faulty  hunan  manory’,  through  cxxputerized  recall  and  alerters. 
They  facilitate  the  analysis  of  a decision  problem  in  advcince, 
and  the  establishment  of  decision  rules  for  use  later  when  speed 
is  critical.  They  provide  algorithms  for  rapid  calculation  of 
tactical  outcomes,  permitting  evaluation  of  alternative  trial 
tactics.  They  furnish  a means  for  the  decision  maker  to  ke^  in 
mind  a wider  range  of  alternatives  during  the  stress  of  battle 
vhen  his  focus  usually  narrows.  And  hopefully  we  will  be  able 
to  provide  guidance  as  to  hew  the  TPC  staff  might  be  structured 
for  most  efficient  use  of  these  techniques. 

These  aids,  as  they  beceme  available,  are  being  progranmed 
on  a man-in-the-locp  simulator  and  tried  out  with  several  typical 
battle  scenarios  to  coipare  their  effectiveness  with  what  might 
be  called  a non-aided  condition  - namely,  a condition  in  vAiich 
data  can  be  made  available  to  the  command  staff  as  it  is  in 
current  systems.  We  hepe  within  a year  to  have  the  first  set  of 
performance  data  frem  these  experiments,  and  then  to  be  able  to 
suggest  hhich  of  these  techniques  are  recaimended  for  further 
development  and  application. 
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DECISICN  ANALYSIS  AND  DECISION  AIDS^ 

by  CLINraj  W.  KELLY,  III 
Peoc4-ton4  and  Vzi-igni,  hicoapofuited 

] 

\ 

The  purpose  of  this  paper  is  to  briefly  describe  a research 
program  designed  to  use  tte  tools  of  classical  decision  theory  to 
develop  decision  aids  that  can  be  used  to  assist  military  deci- 
sion makers  in  near  real-time.  A corollary  objective  is  to  use 
the  structuring  of  the  decision  process  implicit  in  the  develop- 
ment of  such  decision  aids  as  a mechanism  to  train  individuals  to 
be  better  intuitive  decision  makers. 

The  motivation  for  this  research  on  the  developnent  of  deci- 
sion aiding  is  a body  of  evidence  which  indicates  that  even  in 
routine,  urpressured  decision  contexts  people  are  pro»ie  to  many 
biases  and  errors  of  judgment  (Reference  4) . These  tendencies 
toward  suboptimal  decision  performance  are  further  compounded 
under  conditions  of  prolonged  stress  and  fatigue,  and  in  situa- 
tions where  decision  makers  are  subjected  to  information  overload, 
as  is  often  the  case  in  real-time  tactical  decision  contexts. 

The  concepts  behind  the  class  of  decision  aids  currently 
under  investigation  are  relatively  simple.  Decision  analysis 
provides  a means  of  modeling  a variety  of  generic  decision  situ- 
ations to  derive  decision  rules.  These  rules  define  decision 
thresholds  as  a function  of  the  likelihood  of  certain  key  events 
vtiich  bear  on  the  outccme  of  the  decision.  When  a threshold  is 

^he  research  reported  in  this  paper  was  conducted  under  contract 
N00014-74-C-0263  with  the  Office  of  Naval  Research.  The  views  and 
conclusions  presented  are  those  of  the  author  and  should  not  be 
construed  as  representing  a policy  or  conclusicn  on  the  part  of 
the  sponsoring  agency  or  of  any  other  agency  of  the  U.  S.  Govern- 
ment. 
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reached,  the  model  inplies  that  it  is  optimal  to  change  fran  one 
course  of  action  to  another.  Bayesian  probability  models  drawing 
both  on  expert  judgment  and  historical  relative  frequency  data 
can  be  developed  which  provide  a means  of  processing  information 
as  it  arrives  to  yield  time-changing  probabilities  for  those  events 
incorporated  in  the  decision  rules.  These  two  concepts  are  dis- 
played in  Figure  1. 

To  illustrate  the  basic  principles  atployed  consider  the 
decision  problan  described  in  Figure  2.  Tte  decision  is  v*iether 
or  not  to  shoot  at  an  approaching  aircraft  given  uncertainty  as 
to  whether  the  aircraft  is  an  eneny  or  a friendly  plane.  The 
details  of  this  decision  problem  and  the  rationale  behind  the 
values  and  probabilities  incorporated  in  the  model  and  shown  in 
Figure  2 are  described  fully  in  Chapter  1 of  the  Handbook  for 
Decision  Analysis  (Reference  2) . 

There  are  basically  three  parts  to  such  decision  models: 
the  formal  structure  of  the  decision;  the  value  of  each  possible 
decision  outccme,  and  the  probabilities  of  the  uncertain  events 
which  could  affect  the  decision  outcones.  The  formal  structure 
of  the  decision  process  reflects  the  relevant  acts  among  which 
choice  must  be  made  and  the  events  which  could  affect  the  outccme 
of  that  choice.  In  this  case  the  choice  is  to  shoot  or  not  to 
shoot.  Uncertainties  are  whether  or  not  the  aircraft  is  an  eneny 
plane  or  friendly  plane,  and  given  the  decision  to  shoot,  whether 
the  aircraft  is  destroyed  or  not.  If  the  aircraft  is  an  enany 
aircraft  and  is  not  shot  dcwn,  then  whether  or  not  it  succeeds  in 
its  hostile  objective  must  be  considered.  The  second  element  of 
most  decision  models  is  a series  of  values,  shown  in  this  figure 
at  the  extrane  right-hand  side  of  the  decision  diagram,  which 
reflect  the  decision  maker's  relative  preference  for  one  outccme 
of  the  decision  or  another  given  that  for  sure  tlese  outccnes 
occur.  The  rationale  for  assigning  these  values  might  be  quite 
ocmplicated  and  require  additional  submodels.  In  this  case  the 
procedure  used  to  assign  the  values  shown  in  Figure  2 was  a form 
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of  sutmodeling  called  multi-attribute  utility  theory  (Reference  3) . 
The  third  part  of  any  decision  model  is  the  assignment  of  proba- 
bilities to  those  uncertainties  which  could  affect  the  outcome  of 
the  decisicai.  These  prcfcabilities  are  shown  attached  to  the  pos- 
sible outcones  of  each  event  in  Figure  2. 

Once  probabilities  and  values  have  been  assigned  to  the 
decision  model,  it  is  new  possible  to  calculate  for  each  course 
of  acticn  an  expected  value,  which  is  a figure  of  merit  that 
indicates  the  relative  desirability  of  each  course  of  action. 

This  is  done  by  cerputing  prehability-weighted  averages  of  the 
outcome  values.  Frcm  the  probabilities  and  values  contained  in 
the  decision  model  depicted  in  Figure  2,  it  is  apparent  that  the 
best  decision  is  the  course  of  action  "don't  shoot."  This  choice 
is  affected  by  all  of  the  inputs — some  of  which  may  be  subjective 
and  seme  objective — which  are  contained  in  the  model.  For  exartple, 
it  is  clear  that  as  the  probability  of  the  aircraft  being  an  enemy 
is  varied  from  the  current  value  of  15%  up  to  100%,  the  expected 
value  of  not  shooting  will  become  increasingly  negative  and  the 
expected  value  of  shooting  wd.ll  become  increasingly  less  negative. 

Figure  3 shows  the  results  of  a sensitivity  analysis  done 
on  the  probability  of  the  incoming  aircraft  being  an  enany.  Notice 
that  when  the  probability  of  enemy  is  increased  to  a value  of  about 
37%,  the  expected  values  of  shooting  and  not  shooting  are  equal  and 
as  the  probability  of  enemy  increases  beyond  37%,  the  expected 
value  of  shooting  is  greater  than  the  expected  value  of  not  shoot- 
ing, indicating  that  for  a threshold  prcAability  of  37%,  the  deci- 
sion strategy  should  change  frcm  not  shooting  to  shoot. 

This  determination  of  the  probability  threshold  is  an  exairple 
of  a decision  rule  referred  to  earlier.  All  of  us  are  familiar 
with  the  informal  decision  rule  "don't  shoot  until  you  see  the 
vrfiites  of  their  eyes."  The  corollary  rule  in  this  instance  would 
be  "don't  shoot  until  the  probability  of  enemy  exceeds  37%. " It 
is  apparent  that  this  threshold  will  also  be  sensitive  to  changes 
in  the  inputs  contained  in  the  decisicxi  model.  For  exanple,  if 


291 


VALUE  OF 
OUTCOMES 
IN 

EOUIVALENT 

OOLLARS 

(Millions) 


PROBABILITY  OF  ENEMY  - P(e) 


Figure  3 

SENSITIVITY  ANALYSIS  OF  AIRCRAFT 
ENGAGEMENT  DECISION 


292 


1 

1 


the  decision  maker's  preference  (outcane  value)  is  changed  or  if 
sane  of  the  other  prchabilities  in  the  decision  model  are  changed, 
then  the  threshold  will  vary.  Thus,  in  many  instances  the  deci- 
sion rule  should  not  only  be  conditional  t^on,  for  exaitple  the 
probability  of  enemy,  but  should  also  be  conditional  i?»n  other 
inputs  to  the  decisicai  vhich  may  change  with  time. 

Once  a reasc*iable  decision  rule  has  been  developed,  for 
exaitple  a decision  rule  vhich  predicates  changing  courses  of 
action  beised  upon  the  prchability  of  enemy,  then  it  is  necessary 
to  develop  a probability  model  vihich  is  capable  of  transforming 
data  about  the  tactical  situation  into  a tine-changing  probability 
forecast  as  to  vhether  or  not  the  incaning  aircraft  is  an  enany  or 
i;  a friend.  Such  a probability  might  provide  for  the  inclusion  of 

I*  signals  intelligence  indicating  whether  or  not  an  IFF  signal  has 

I ' been  received  from  the  incoming  aircraft,  a visual  sighting  of 

! the  aircraft,  and  so  forth.  Ctoviously,  the  prciiability  model  will 

; be  more  conplex  vdien  the  enaty  threat  is  of  major  consequence. 

I The  decision  aid  would  then  consist  of  a mechanism  to  catpare  this 

I time-changing  probability  with  the  thresholds  established  by  the 

! decision  rule  to  identify  that  point  in  the  evolving  situation 

I vhen  the  decision  naker  should  consider  changing  his  course  of 

I action.  Such  an  aid  should  also  display  to  the  decision  maker  the 

I rationale  behind  both  the  decision  rule  and  time-changing  prob- 

f ability. 

[ The  basic  principles  presented  above  have  been  used  to 

develop  a prototype  decision  aid  that  will  be  described  in  the 
j remainder  of  this  paper. 

In  the  development  of  a decision  aid,  a key  issue  is  a means 
of  displaying  the  tine-changing  probabilities  of  events  in  rela- 
tion to  the  thres.'-iolds  that  constitute  the  decision  rule.  It  is 
I possible  to  iitegine  decisice-aiding  systans  in  which  the  time- 

changing probabilities  would  be  caipared  with  a preset  threshold 
by  a conputer,  so  that  when  the  threshold  was  r^ched,  seme  sort 
of  signal  would  be  provided  to  the  decision  naker.  Such  a system, 
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however,  would  lack  several  inportant  characteristics  that  vo 
believe  are  essential  to  any  decision  aid.  First,  it  would  not 
provide  a decision  maker  with  a means  of  extrapolating  trends 
wdth  respect  to  the  time-changing  probability  and  of  intuitively 
estimating  roughly  wtien  a threshold  might  be  reached.  Thus, 
there  would  be  no  basis  for  preparatory  actions  that  may  need  to 
be  acccnplished  by  the  time  the  threshold  is  reached.  Second, 
such  a systan  would  pre-suppose  that  all  of  the  relevant  factors 
essential  to  a decisicn  have  in  fact  been  included  in  the  aid. 

The  decision  maker  would  then  be  placed  in  a position  of  having 
to  accept  this  on  faith  rather  than  having  all  of  the  data  and 
the  implications  of  the  data  displayed  so  that  he  could  evaluate 
for  himself  whether  the  key  variables,  as  he  perceives  them,  are 
in  fact  accounted  for  in  the  decision  aid.  Thus,  the  prototype 
decision  aid  wW.ch  has  been  developed  focuses  as  much  on  display- 
ing all  relevant  information  to  the  decision  maker  for  his  review 
and  possible  modification  as  it  does  on  displaying  the  iirplica- 
tions  of  that  information  for  action  selection. 

For  this  decisicsi  aid,  three  principal  displays  are  used. 
These  are  shewn  schematically  in  Figure  4.  They  include  a primary 
action  display  in  which  the  time-changing  probability  is  coipared 
with  the  decisicsi  thresholds,  an  intelligence  display  (likelihood 
table)  in  which  the  data  that  have  been  received  and  the  implica- 
ticsis  of  those  data  with  respect  to  probabilities  of  concern  are 
displayed,  and  a value  display  expressed  in  terms  of  the  decision 
maker's  relative  degree  of  regret  for  various  choices  and  their 
outcemes.  The  intelligence  display  provides  the  information 
which  drives  the  time-changing  probability,  and  the  value  display 
provides  the  informaticxi  that  is  responsible  for  setting  the 
decision  thresholds. 

The  time-variant  profcabilities  are  shown  by  using  a track  or 
vector  that  moves  in  a triangular  space.  An  equilateral  triangle 
is  used  as  a display,  in  this  case,  because  it  has  the  property 
that  any  point  inside  the  triangle  can  represent  three  probabili- 
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ties  that  sum  to  1.0.  Thus,  if  one  is  dealing  with  an  uncertainty 
that  has  three  mutually  exclusive  and  exhaustive  possible  states, 
the  point  in  the  triangle  will  represent  the  probability  vector 
over  those  three  states.  An  exanple  of  this  protability  track 
moving  within  the  triangular  space  in  response  to  changing  infor- 
mation is  shown  in  Figure  5.  The  closer  the  probability  track 
is  to  one  of  the  vertices  of  the  triangle,  the  more  likely  the 
particular  state  described  by  that  vertex  is  to  occur. 

Figure  6 shows  the  same  triangle  now  with  action  thresholds 
overlayed  on  top  of  the  probability  space.  The  implication  of 
this  figure  is  that  as  long  as  the  prc±ability  track  remains  in 
a particular  region  bounded  by  a threshold,  it  is  appropriate  to 
carry  out  one  type  of  avtion;  and  as  the  track  moves  across  the 
threshold  into  another  region,  it  is  ajprcpriate  to  change  the 
course  of  action.  These  thresholds,  as  we  mentioned  earlier,  are 
set  by  the  values  assessed  by  the  decision  maker.  They  represent 
his  judgment  with  respect  to  the  relative  regret  over  different 
kinds  of  actions  and  outccmes  considering  a variety  of  criteria 
that  may  be  more  or  less  important  in  a particular  operational 
context.  A detailed  treatment  of  how  the  thresholds  are  set  and 
how  the  probabilities  are  assessed  is  contained  in  fSeference  1. 

When  the  decision  aid  is  in  use,  information  is  received 
over  time  and  the  probability  track  moves  in  the  triangle  in 
response  to  changing  probabilities.  Courses  of  action  are 
reccmended  by  virtue  of  the  track  crossing  frcm  one  region  of 
the  triangle  into  another. 

A wide  variety  of  "what  if"  analyses  ai‘e  possible  using  this 
prototype  decision  aid,  which  again  emphasizes  that  the  role  en- 
visaged for  a decision  aid  is  that  of  an  aid — a mechanism  that 
would  help  extend  the  intellect  of  the  decision  maker  and  put  i 

structure  to  what  otherwise  might  be  a confusing  situation,  rather  j 

than  a device  which  makes  decisions  according  to  pre-set  rules  j 

that  are  prograntned  without  any  form  of  intervention  by  the  deci--  j 

sion  maker.  These  "vhat  if"  analyses  include  the  ability  to 
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change  the  iitpact  of  different  types  of  informatics  that  might  be 
received,  to  postulate  an  occurrence  that  has  not  yet  happened,  to 
vary  the  inportance  assigned  to  different  criteria,  and  to  vary 
the  cost  of  different  kinds  of  errors.  As  any  of  these  changes 
are  made,  the  inplications  of  the  changes  for  action  selection 
are  displayed  to  the  decision  maker  for  his  review.  It  is  worth- 
while mentioning  that  in  this  particular  inplementation  of  a deci- 
sion aid,  there  is  a formal  probability  model,  called  a Bayesian 
hierarchial  model,  that  acccnplishes  the  transformation  of  verbal 
and  qualitative  information  into  a probability  distribution  over 
the  outcomes  of  concern.  This  model  is  presented  in  detail  in 
Reference  2. 

Ti>e  preceding  discussion  has  focused  on  situations  vhere 
there  has  been  but  one  key  uncertainly — whether  or  not  the  in- 
ocming  aircraft  was  an  enany  or  a friend  or,  in  the  case  of  the 
prototype  decision  aid  itself,  the  principle  uncertainty  was 
eneny  intent  described  in  terms  of  three  possible  states.  Imagine 
now  a situation  where  multiple  uncertainties  are  of  concern.  For 
exanple,  in  a decision  as  to  vhen  to  launch  an  air  strike  (or 
other  major  action)  against  an  eneny,  we  might  be  concerned  with 
own-force  readiness,  with  weather  over  the  target  area,  and  with 
enemy  readiness.  For  a situation  of  this  sort,  we  use  a display 
consisting  of  multiple  triangles,  one  triangle  corresponding  to 
each  of  the  key  uncertainties.  Such  a display  is  shown  in  Figure 
7.  This  display  has  the  interesting  property  that  as  the  prob- 
abilities with  respect  to  one  uncertainty  are  ipdated,  the  prob- 
ability track  will  move  in  that  triangle  and  the  thresholds  will 
remain  fixed.  Because  of  consistency  requirements  which  are 
inposed,  the  probability  thresholds  must  therefore  move  in  the 
other  triangles.  Correspondingly,  if  two  or  more  of  the  uncer- 
tainties are  updated  simultaneously,  then  the  probability  tracks 
and  the  thresholds  will  move  in  each  of  the  triangles. 

Although  the  theoretical  underpinnings  of  the  decision  aid- 
ing concept  described  above  are  sound  and,  by  logical  inference. 
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Figure  7 

DISPLAY  FOR  MULTIPLE  UNCERTAINTIES 


should  lead  to  inproved  operational  performance  in  decision  situ- 
ations, the  formal  evaluations  required  to  assess  the  applied 
utility  of  the  decisicn  aid  have  yet  to  be  conducted.  Plans  for 
such  validation  Mark  are  now  in  preparation.  An  informal  pilot 
project  to  help  formulate  a suitable  validation  plan,  simulating 
tactical  engagements  while  using  the  prototype  aid,  were  conducted. 
At  the  anecdotal  level,  subjects  generally  thought  the  aid  would 
be  useful,  with  further  refinements,  as  an  on-line  tactical  aid. 

The  subject's  responses  also  indicated  that  the  aid  would  be 
valuable  as  a training  device  to  enable  new  task  force  cormanders 
to  beccme  familiar  with  the  tactical  situation  modeled  in  the 
decision  aid,  and  to  test  alternative  response  actions  in  train- 
ing exercises. 

Clearly,  additional  research  remains  to  be  done  to  bring 
decision  aiding  concepts,  wliether  the  prototype  aid  discussed 
here,  or  others,  to  fruition.  Beyond  the  obvious  but  difficult 
research  issues  inherent  in  the  validation  of  this  decision  aid- 
ing concept,  further  research  is  needed  to  assess  the  utility  of 
the  concept  as  a training  device,  to  determine  the  ability  of 
people  to  process  information  derived  fron  the  multiple-triangle 
display,  and  to  search  for  alternative  display  methods. 
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Otto  Wech:  Are  you  addressing  directly  to  the  Oomnander  as 
operator  or  are  you  envisioning  that  the  Ocmander  interacts  with 
the  system  by  his  staff: 

Denicoff : Either  way.  Fran  what  we  know  of  decision  makers  of 
that  level,  they  tend  to  operate  differently.  They  tend  to  use 
their  staff  differently.  Sane  of  them  make  extensive  use  of 
specialists  and  sane  of  them  like  to  get  into  details  themselves. 

Let  me  make  one  comment  here,  again  I think  we  are  trying  to 
build  in  maximun  flexibility.  I very  often  here  dogmatic  state- 
ments in  your  direction.  Namely  the  dogmatism  says  the  Ccmander 
will  never  sit  down  and  be  terminal  - utter  nonsense.  I have 
seen  flag  officers  working  at  terminals  and  even  get  excited  about 
that  type  of  interaction.  I think  there  will  turn  out  to  be  as 
much  Vcuriance  as  there  are  individuals.  Seme  senior  officers 
will  always  want  to  rely  on  staff  manbers.  Others  will  want  to 
interact  on  their  own.  One  premise  I have  is  every  time  you  have 
to  use  am  intermediary  - another  person  - there  is  seme  restric- 
tion, seme  inhibition.  If  we  are  going  to  have  feed-back,  and 
that  if  feed-back  has  to  go  through  a second  and  third  generation 
until  it  gets  to  its  Coimander,  a hell  of  a lot  is  lost.  So  there 
may  be  a real  gain  in  seme  instances  of  having  direct  interaction 
between  various  people  and  the  data  base.  At  lease  we  want  to 
provide  that  capability  that  can  be  used  or  ignored. 

Wech:  At  what  level  of  steps  do  you  determine  the  ability  of  the 
system  to  self  adjust?  Do  you  have  control  over  that?  Or  is  it 
a hardware  or  software  given  feature  that  you  just  take: 

Denicoff:  I would  say  we  have  two  interests.  One  is  to  look  at 
a particular  ccwifiguration  as  a constraint  on  the  world.  Namely 
what  is  the  best  that  can  be  done  given  that  constraint?  The 
constraint  might  be  a hardware  of  soft  constraint  in  the  form  of 
a system  that  has  been  posed.  We  must  ask  again,  what  constraints 
have  been  iitposed  by  that  systan?  Ha«:  can  those  constraints 
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be  alleviated  given  the  restriction  of  that  system?  That's 
one  goal.  The  other,  I think,  is  a more  research  oriented  goal, 
to  end  up  with  the  specifications  for  the  kind  of  hardware  and 
software  that  has  to  be  developed  to  make  all  these  desirable 
capabilities  possible.  So  one  is  to  live  with  those  real  world 
constraints.  The  other  is  to  write  a specification  to  alleviate 
those  constraints.  You  have  both  objectives. 

Question:  It  seems  that  this  process  has  a tremendous  appetite 
for  nimbers  and  an  underlying  distribution.  Will  you  say  scme- 
thing  about  how  you  are  going  to  obtain  this? 

Kelly:  Well,  actually  I wrould  argue  that  it  doesn't  have  too  big 
an  appetite  for  nunbers.  The  naiber  of  judgments  required  for  the 
model  I just  described  would  take  an  experienced  intelligence 
officer  scmething  on  the  average  of  toro  to  three  hours  to  prepare 
in  advance  and  certainly  no  more  than  that.  I might  add  that 
recently  I had  an  opportunity  to  work  on  the  problem  that  evolved 
in  near  realtime.  We  created  a variant  of  this  model  and  we  were 
able  to  get  the  necessary  input  to  both  stage  two  and  stage  three 
in  about  two  hours.  That  says  nothing  about  the  validity  of  the 
nutttoers  and  really  what  we  are  trying  to  do  is  find  out  if  deci- 
sion rules  that  are  reasonably  invariant  can  be  identified. 
Sacerdoti : I have  a slightly  related  question  here;  how  sensitive 
is  the  consistencies  of  those  numbers  and  underlying  models  to  be 
used  because  we  will  be  dealing  with  different  pieces  of  the  pro- 
blem at  a time. 

Kelly:  It  is  rather  hard  to  answer  that  without  getting  very 
specific.  Some  models  are  not  very  sensitive  at  all  and  in  others 
it  makes  a tremendous  difference.  For  example,  in  the  illustra- 
tion I used,  you  could  vary  the  weight  assigned  to  the  different 
criteria  over  a wide  range,  or  even  drop  any  of  the  four  value 
criteria  and  it  wouldn't  itake  einy  difference.  In  other  models, 
of  course,  that  is  certainly  not  the  case.  I am  sure  there  must 
be  some  underlying  generalities,  rules  of  thurrt),  we  could  use  to 
help  us  make  judgments  of  that  sort,  but  we  have  not  been  able  to 
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identify  many  of  them  at  this  time. 

Bracken : In  the  model  that  you  constructed,  as  I understand  it, 
there  are  various  actions  available  to  Blue,  certain  probabilities 
of  Blue  taking  those  actions  or  perhaps  adopting  a mixed  strategy. 
Kelly:  Ihe  model  that  we  constructed  purports  to  show  that  Blue 
showed  do  given  uncertainty  about  what  Red  will  do.  It  says 
little,  if  anything,  about  the  likelihood  that  Blue  will  in  fact 
take  that  direction. 

Bracken:  Well,  let  me  ask  the  question  in  another  way.  How 
would  you  generalize  this  model  if  you  were  locking  at  things  in 
a game  theoretical  context,  where  Blue  had  available  to  him  seme 
actions  he  might  take  with  certain  possibilities  and  Red  did  the 
same. 

Kelly:  One  way  is  sinply  to  say  that  the  likelihood  that  Red  is 
going  to  do  something  would  be  conditional  upon  what  Blue  chooses 
to  do  and  you  siitply  represent  it  in  the  form  of  a conditional 
probability.  You  run  it  out  until  sufficient  time  elapses  so 
that  carrying  it  beyond  that  point  simply  has  no  effect  on  the 
choices  ou  are  faced  with  inmediately . The  simple  little  model 
that  I described  didn't  have  that  kind  of  conditionality  in  it. 
Others  certainly  cio.  For  example,  the  choice  of  whether  or  not 
to  use  certain  tactical  nuclear  options  in  Europe  would  determine, 
to  an  extent,  what  the  Warsaw  Pact  might  do.  If  you  lex*  at  that 
situation,  you  would  work  with  probabilities  that  are  directly 
conditional  on  your  own  choices. 

Bracken:  I think  that  a probability  approach  is  called  for  here, 
not  game  theory. 

Kelly:  That  is  absolutely  right.  As  a decision  theorist  I would 
approcich  it  that  way,  not  through  game  theory,  although  one  might 
veil  approach  it  using  game  theory. 

Bracken;  Don't  you  think  there  are  seme  inconcistencies? 

Kelly;  ND,  but  I am  certainly  willing  to  be  educated.  I can't 
think  of  any  inconsistencies  - none  ceme  to  mind. 
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Bracken:  Well,  if  it's  a sequence  of  simultaneous  moves,  then 
you  don't  get  an  opportunity  to  ctoserve  while  you  are  moving.  If 
it  is  a sequence  of  moves  where  Blue  moves.  Red  moves.  Blue 
moves,  then  you  get  a chance  to  observe,  but  if  tiiey  are  moving 
simultaneously. . . 

Kelly:  Ihere  is  a difference  between  v^iat  one  actually  sees 
unfolding  in  the  world  and  hew  one  constructs  a decision  diagram 
that  would  help  you  choose  a course  of  action  today.  You  can 
certainly  construct  a decision  diagram  today  under  the  assumption 
that  the  moves  will  be  simultaneous  and  not  sequential.  In  that 
case,  of  course,  the  probability,  at  least  for  the  first  stage 
moves  of  Red,  will  not  be  conditional  upon  what  we  do. 

Bracken:  What  do  you  do  then? 

Andrews:  I guess  you  would  make  an  estimate  of  the  situation 
based  on  the  intelligence  you  have  available.  This  may  not  sean 
to  be  a very  satisfactory  answer,  but  it  appears  to  be  the  only 
one  available. 

J.  Ihoipson:  If  you  are  saying  to  use  a diagram  such  as  you  have 
indicated  as  an  Educational  Aid,  I think  these  are  useful.  But 
if,  as  I understand,  you  are  actually  proposing  this  to  be  a 
decision  aid  in  real  time,  in  real  world  situations,  I find  it 
absolutely  terrible  I Ihat  is  a tactic  Germander  vho  is  goirq  to 
be  sitting  in  Washington  watching  a stochastic  b\^  walking  across 
a triangle  vhich  has  probabilities  vdiich  are  very  fuzzy  and 
utilities  which  are  very  fuzzy.  It  seems  to  me  very  dangerous. 
Particularly  since  the  CIA  syndreme  may  tell  him  that  as  soon  as 
the  bug  crosses  the  attack  boundary,  we  should  attack. 

Kelly:  I don't  think  it  actually  says  that. 

J.  Thompson:  Well,  that  is  not  vhat  it  says.  It  says,  based  upon 
the  inputs  and  under  these  conditions,  you  should,  in  fact,  pre- 
pare to  attack  and  execute.  Now,  just  as  the  trigger  that  Bob 
was  talking  about  earlier  in  respect  to  Daisy  is  designed  to 
evc^e  some  kind  of  response  from  the  decision  maker,  to  that 
extent,  this  model  does  exactly  the  same  thing.  It  is  designed 
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as  an  aid,  based  upon  the  conmander's  perception  of  the  situation, 
with  sane  of  the  data  put  in  ahead  of  time  and  sane  put  in  in 
real  tine. 

J,  Ttigipson:  Not  basically  though,  I mean  it  is  the  decision  part 
and  therefore  it  is  a bit  more  than  just  useful  infometion.  I 
think  your  exanple  about  what  things  have  been  tried  in  business 
works  pretty  well.  It  points  out  a key  difference  between  a 
military  situation  and  a business  situation.  That  is,  nations 
can't  take  the  bankrupt  law.  If  you  try  sonething  based  on  such 
and  such  data  and  such  and  such  a utility  function  in  business  and 
you  are  wrong,  you  just  take  the  bankrupt  law  and  wait  six  months 
and  you  start  over  again.  Nations  can't  do  that. 

Kelly:  Well,  let  me  answer  that  in  the  following  way.  You  said 

this  terrified  you,  but  there  is  something  that  ought  to  terrify  ) 

you  more  and  that's  a tactical  ccrmander  trying  to  do  all  of  this 

in  his  head  by  unaided  intuition.  The  psychological  evidence  on  . 

this  topic  says  that,  our  feelings  to  the  contrary,  people  don't  do  | 

as  good  a job  as  we  may  think  they  do.  j 

J.  Thoipson:  I am  sorry,  but  I am  willing  to  trust  this  to  an  : 

experienced  Conmander.  In  certain  situations  he  gets  his  infor-  ! 

nation  from  the  Secretary  of  State,  maybe  even  the  President. 

But  you  are  really  talking  about  a situaticx:  vihere  Blue  was  the 
United  States.  This  is  an  honest-to-God  situation.  You  watch  it 
in  simulation.  If  I understand  it  correctly,  the  way  you  are 
talking  about  it  in  such  a situation  vhere  Orange  is  the  satellj  te 
state  of  Red  and  Blue  is  the  U.S.  Here  is  the  Comander  watching 
the  little  bug  walking  around  instead  of  getting  on  the  connuni- 
cations  system  and  getting  all  the  information  he  can  frcm  his 
subordinates  and  also  from  his  superiors.  I think  that  terrifies 
me  a good  deal  more  than  anything  that  is  in  the  head  of  one 
individual. 

i Kelly:  The  aid,  of  course,  does  not  preclude  the  Cotmander  from 

I seeking  information.  In  fact  it  is  designed  to  help  him  identify 
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what  inforTTBtion  he  ought  to  be  looking  for  and  can  assist  in  the 
formidable  task  of  integrating  all  that  information.  This  not- 
withstanding, I think  the  concern  you  express  highlights  an 
extremely  inportant  issue  - one  that  we  are  going  to  be  evaluating 
during  the  next  year.  What  I have  presented  is  a tool.  To  tlie 
extent  that  it  is  used  oorrectly,  I believe  it  can  be  of  use,  and 
can  be  quite  valuable.  If  you  have  someone  who  says,  "Gosh,  the 
bug  crossed  the  threshold  and  therefore  I am  going  to  push  the 
button,"  you  have  a misuse  of  this  model.  I think  it  is  most 
important  to  keep  the  context  straight.  WJiat  we  are  talking  about 
is  a sophisticated  aid  - a clever  version  of  a Coimander's  night 
order  book,  so  to  speak.  Nothing  really  different,  except  for 
the  irrplementation  and  the  underlying  framework,  from  the  system 
used  in  the  British  Navy  today.  I share  your  concern  because  one 
of  the  things  that  bothers  me  is  the  possibility  that  people  won't 
use  this  correctly.  I do  knew  enough  about  unaided  intuition  to 
know  that  there  are  some  good  decision  makers  and  some  bad 
decision  makers.  I think  that  for  those  that  aren't  as  facile  as 
others,  something  like  this  is  prctoably  a better  alternative  than 
muddling  through  without  the  aid. 

Welch:  Let  me  understand  vhat  you  are  saying  here.  It  seems  to 
me  that  one  w^  to  describe  vhat  you  have  there  is  a way 
systanatically  to  mix  current  data  with  another  set  of  data  with 
a set  of  value  judgments,  of  a set  of  logic  connections,  which  you 
thought  up  prior  to  the  event.  For  example,  the  logic  tree  and 
the  different  kinds  of  concern  and  the  weight  you  put  on  those 
concerns.  That,  to  me,  seate  to  be  considered  data  eis  well  as 
anything  else  including  the  mission  you  are  given  among  other 
things.  It  does  seem  to  me  one  simple  way  to  describe  vhat  you 
chooose  to  talk  about  is  at  least  a systematic  way  of  mixir^ 
current  data  on  situatic*is  cind  post  data. 

Kelly:  That  is  absolutely  correct  ad  it  mi^t  be  thou^t  of  in 
another  sense  - as  a way  to  integrate  both  the  J2  and  the  J3 


functions  while  preserving  their  integrity. 

Boncfcr:  It  is  a bit  more  than  that  Jeff.  It  docs  suggest  that 
if  one  were  "rational"  one  would  act  per  the  action  space 
partitioning . 

Kelly:  Right.  I am  assuming  that  you  have  all  the  risk  and  ever” 
thing  else  included,  much  of  which  I didn't  even  talk  about. 

Bonder:  There  is  an  action  space  there  that  is  divided  and  it 
is  divided  based  on  beliefs  and  certain  assumptions  made  by  a 
great  mthematician  a few  years  ago.  The  tree  folding  back  is 
based  on  some  logic  that  is  sore  set  of  assunptions  about  how  one 
folds  back  trees.  One  folds  back  trees  that  way  if  you  believe 
the  "assumption"  on  hew  to  fold  back  trees.  I am  not  saying  they 
are  right  or  wrong.  I am  just  saying  there  are  explicit  rules  on 
hew  to  fold  back  trees.  All  I am  saying  is  the  Cermander  should 
knew  he  has  certain  transitivity  kinds  of  beliefs  about  the  world 
before  he  should  say,  "I  see  that  kind  of  spac;e,  I'll  that  way." 

You  all  know  what  I am  talking  about  I think,  insofar  as  what  axiems 
I am  referring  to.  If  he  believes  in  it,  fine.  If  he  doesn't 
he  ought  to  think  about  it  a little  stronger  before  he  says  seitie- 
thing.  It  is  more  than  just  a data  basis.  It  is  a decision 
making  logic  that  is  considered  to  be  rational  if  you  believe  in 
a certain  set  of  axioms.  All  I am  saying  is  a Ccnniander  should 
know  what  they  are  if  he  wishes  to  follcw  that  kind  of  prescrip- 
tion. 

George  tAigh:  1 think  the  thing  that  bothers  me  most  about  the 
decision  aid  is  the  underlying  assumption  that  you  conditional 
probabilities  are  constant.  I understand  that  the  user  puts  the 
conditional  probabilities  in  on  the  assumption  of  various  scena- 
ricjs  that  he  thinks  of  as  possible  alternative  enany  courses  of 
acticn.  If  a different  set  of  scenarios  begin  to  unfold,  he  might 
have  wished  he  had  put  in  different  conditional  probabilities. 

cjuestion  is;  Do  you  have  in  mind  seme  way  of  testing  the  pro- 
bable constancies  of  the  conditional  probabilities  in  seme  sort 
of  situations? 
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Kelly;  What  we  are  doing  now  is  locking  at  a variety  of  scenarios 
using  the  sane  framework  and  siitply  trying  to  get  a feel  for  the 
extent  to  which  these  prc^flbilities  change,  and  vhat  characteri- 
stic of  a scenario  is  responsible  for  the  change.  This  then 
should  lead  us  to  a variety  of  updating  and  interpolation  methods. 
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REMARKS  ON  THE  PRESENTATION  GIVEN  BY  DR.  CLINTON  KELLY 

by  J.  R.  THOMPSON 
Rice  Un^viMitij 


If  the  "decision  aid"  suggested  by  Dr.  Kelly  were  sirtply  an 
educational  device,  I should  not  be  excessively  disturbed.  But 
he  has  made  it  clear  that  his  model  is  to  be  used  in  real  time 
tactics  against  Russian  vessels.  I find  this  sijiply  terrifying. 
Ihe  possibility  that  a ccrmander  in  a crisis  would  spind  his  time 
watch  a stochastic  bug  walk  across  a decision  triangle,  ready  to 
push  a button  if  the  attack  boundary  were  crossed,  has  a hybrid 
Rube  Goldberg-Doctor  Strangelove  flavor.  The  input  to  the  "aid" 
is  of  necessity  extremely  noisy — both  in  terms  of  the  relevant 
prcbabilities  and  utilities.  The  brain  of  an  experienced  can- 
mander  is  far  better  suited  to  the  ccmplex  task  of  decision  ma):ijTg 
in  the  situation  described  by  Dr.  Kelly  than  any  systems  analysis 
"aid"  yet  devised. 

Moreover,  the  existence  of  such  an  "aid"  would  provide  a 
dangerous  terptation  for  a ccnmander  to  use  the  black  box  instead 
of  his  CMn  judgment.  Consider  the  case  vvhere  the  connander  pushes 
the  button  when  the  bug  crosses  the  boundary.  Whatever  the  nega- 
tive result  might  be  (including  a war)  the  connander  could  in  any 
subsequent  court  martial  make  an  authority  ajpeal  to  the  "aid"  as 
to  a "suggestion"  fron  a superior  officer. 

One  of  the  reasons  why  management  science  procedures  fre- 
quently are  inappropriate  for  military  decisions  is  the  fact  that 
there  is  no  bankruptcy  law  for  superpowers.  If  a business  uses 
such  a device  as  that  suggested  by  Dr.  Kelly  and  the  decisicai 
advocated  is  wrong,  the  worst  that  can  happen  is  that  the  firm  is 
forced  into  bankrtptcy.  The  manbers  of  the  firm  may  then  rein- 
corporate and  try  again.  Thus,  the  riskiness  of  decision  making 

in  business  is  not  of  the  same  kind  as  that  experienced  in 
military  situations. 
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ADVANCED  DATA  PROCESSING  CONCEPTS  FOR  NAVAL  TASK 
FORCE  DECISION  MAKING 


by  MARVIN  DENICOFT 
0(,iic.z  of)  Naval 

I 

I 

This  talk  is  directly  related  to  Dr.  Tolcott's  paper;  it 
provides  an  extension  in  the  Informaticai  Systems  area  to  Tolcott's 
discussion  of  Decision  Aids  for  Naval  Task  Force  Ccrmanders. 

More  so,  perhaps,  than  any  other  field,  advancement  in  com- 
puter science  is  frequently  contaminated  or  marred  by  exaggera- 
tions of  the  true  state  of  development.  For  exanple,  while  con- 
siderable progress  has  been  made,  it  is  simply  not  true  that 
decision  makers  can  routinely  avail  themselves  of  sush  desirable 
oonputational  tools  as:  on  line-real  time  interrogation  of  stored 
data,  written  or  spoken  Fliglish  language  interacticxi  with  ccnpu- 
ters,  extensive  use  of  management  by  exertion  principles.  These 
features  certainly  are  anong  the  most  frequently  described  goals 
of  modem  management  sup>port  systems;  yet,  we  have  stated  the 
objectives  so  forceably  as  to  fail  to  nake  careful  descriminations 
between  truth  and  myth,  reality  and  fiction. 

The  Office  of  Naval  Research  Operational  Decisicn  Aiding  Pro- 
ject (ODA) , described  by  Marty  Tolcott,  has  among  many  interests, 
the  goal  of  capturing  for  the  Task  Force  Cermand  level  the  latest 
progress  on  cotputing  science  while  providing  a laboratory  facil- 
ity for  testing  the  readiness  and  appropriateness  of  advanced 
cerputer  concepts  to  conmand  and  oontrol  requiranents.  Along  with 
' such  always  desired  front  ends  as  real  time  and  natural  language 

interaction,  ODA  is  concerned  with  evaluating  data  base  managanent 
systans  and  information  storage  techniques  which  must  be  op)era- 
tional  if  our  sexier,  more  visible  prescriptions  for  curing 
problems  are  to  have  any  impact. 
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In  the  ODA  context,  the  University  of  Pensylvania's  Wharton 
School  is  the  OMR  contractor  responsible  both  for  developing 
coiputat ional  aids,  and  for  creating  the  general  conputational 
tost  facility  essential  to  evaluating  decision  science  and  opera- 
tions research  methodologies  as  \«ell  as  information  science  tech- 
nuqies.  My  talk  today  will  be  limited  to  a description  of  the 
Wharton  School's  role  in  defining  and  making  ready  for  test  a set 

of  near  term  ccnputational  aids  \Ahich,  in  their  view  and  ours, 

2 

seem  applicable  to  the  C Task  Force  situation. 

Let  me  begin  by  underscoring  that  the  University  of  Pennsyl- 
2 

vania  work  on  C results  frcm  three  years  of  previous  basic 
research  funding  on  designing  concepts  for  coping  with  large  data 
base  problems.  Building  on  tlieir  own  efforts  in  this  curea  and 
that  of  other  OMR  contractors  (Cal  Tech,  SRI,  and  University  of 
Illinois) , Penn  made  a conscious  selection  of  those  research 
results  v^tlich  satisfied  the  conditions  of  being:  (1)  most  ready 
for  test,  and  (2)  most  suitable  for  C^.  While  the  test  program 
will  not  get  underway  until  claneder  year  1977,  Penn  has  already 
begun  to  establish  a ccrputational  test  facility  that  includes 
PDP  10  Sl  11  ccnputers;  interative  terminals;  large  aixl  small 
screen  black  and  vdiite  and  color  displays;  and  such  mechanisms 
for  interacting  with  display  as  the  lite  pen,  the  track  ball,  and 
the  electronic  mouse.  To  these  assets,  the  ccmpleted  facility  will 
add:  (1)  C decision  models  and  algorithms  for  test  and  evalia- 
tion,  (2)  human  subjects,  (3)  an  experimental  design  plan,  and 
(4)  a methodology  for  cost/effectiveness  measurement  of  test 
results.  Additionally,  the  test  facility  operation  includes 
scenarios  vdiich  are  approximations  of  real  world  conflict  situa- 
tions, and  a rich,  live  data  base  descriptive  of  US  and  enemy 
naval  forces,  and  geographic  and  envirormental  conditions  for  a 
"mythical”  part  of  our  modem  world. 

Now  I viould  like  to  turn  to  a brief  discussion  of  the 
initial  set  of  computational  aids  already  programmed  by  Penn  for 
later  evaluation  in  the  test  facility.  These  aids  may  be  divided 
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into  tvvo  categories;  front  end  representing  mechanians  to  improve 
man's  facility  and  cptions  for  interacting  with  ccmputers;  and 
back  end  descriptive  of  techniques  for  storing  and  retrieving 
data  in  a real  time  decisiOTi  envirorment. 

Among  the  available  front  end  conputer  aids  is  a natural  or 
English  language  interrogation  capability.  Questions  nust  be 
typewritten;  no  speech  interaction  nade  is  currently  contenplated 
for  OD.A.  The  natural  language,  system,  modeled  after  a develop- 
ment  at  Cal  Tech,  permits  questions  to  be  asked  of  the  C data 
base  in  a restricted  form  of  Eiiglish.  Permissable  are  such  ques- 
tions as  : (1)  taiiich  ships  in  the  data  base  are  configured  with 

a designated  radar  or  sonar?,  (2)  What  is  the  maximjm  speed  of  a 
particular  ship  or  aircraft?  or  (3)  What  are  the  operational 
characteristics  of  a specified  weapon?  Interrogation  is  restricted 
in  that  the  use  of  synonyms  is  severely  limited;  further,  the  size 
of  the  English  dictionary  and  relationships  across  data  fields  is 
constrained.  The  just  described  English  language  processing 
system  includes  a fairly  s<^histicated  spelling  corrector.  More 
advanced  natural  language  systans  are  beginning  to  emerge  from 
the  basic  research  program  and  will  be  considered  for  later 
inoorporation  in  the  ODA  Project. 

A concern  of  natural  language  interactive  capability,  given 
the  present  state  of  the  art,  is  the  imposition  on  the  user  or 
manager  to  learn  a formal  grammar  or  ccnputerize.  This  granmar 
or  rule  book  (protocols)  must 'be  memorized  and  anployed  explicitly 
if  serious  errors  and  "hang-rps"  are  to  be  avoided.  Among  the 
unanswered  questions  and  ones  to  be  tested  by  ODA  are  whether 
management  will  make  the  investment  to  familiarize  itself  with 
the  conplex  syntax  of  coiputer  interaction,  and  vhether  such 
interactive  complexities  will  hold  up  and  work  under  battle  stress. 
An  alternative  to  an  English  language  interactive  mode  is  a touch 
screen  or  menu  display  system;  this  too  to  be  evaluated  in  ODA. 

In  this  case,  decision  options  are  displayed  on  a screen;  the 
user  points  to  or  keys  in  a desired  choice  and  he  is  led  inevitably 
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to  particular  display  refinanents  directly  reflective  of  his  con- 
cern. 

As  new  oontenplated  by  ODA,  the  test  program  will  include  the 
English  language  interrogation  capability,  a touch  screen  mexie, 
and  an  option  mixing  touch  screen  with  limited  typewritten  English 
language  input. 

To  the  further  interest  of  displaying  coiputer  output,  Penn 
has  designed  a screen  segmentation  or  split  window  concept.  The 
screen  segmentation  conc^t  contrasts  with  an  alternative  of 
multi  screen  displays.  In  the  current  Penn  design,  the  C dis- 
play is  divided  into  five  pciirts;  each  part  having  a unique 
scrolling  capability  and  a capacity  for  being  treated  as  though 
it  reacted  to  our  was  controlled  by  its  owi  s^arate  cerputer. 
While  the  present  design  is  a fine  segment  screen,  it  is  inpor- 
tant  to  note  that  the  raw  capability  new  exists  to  decrease  or 
expand  from  a huitan  engineering  standpoint.  To  add  to  your  infor- 
mtion  base,  the  contarplated  fine  segments  will  be  used  for: 

(1)  displaying  inputs  or  interrogations  framed  by  a particular 
user,  (2)  showing  outputs,  results  of  models,  and  answers  to 
questions,  (3)  displaying  messages/message  traffic  tailored  to 

each  user,  (4)  indicating  the  assigmvent  and  realization  of 

2 

"alert  or  alarm"  conditions  appropriate  to  the  C situation,  and 
(5)  establishing  a time  clock  or  date/time  stanping  of  cill  com- 
puter interactions. 

The  design  and  ultimate  testing  of  an  "alerting"  capability 
is  one  of  the  most  exciting  Wharton  School  software  packages 
available  for  ODA.  To  appreciate  the  potential  utility  of  an 
alerting  or  triggering  mechanism,  one  has  only  to  reflect  on 
the  passive  nature  of  the  best  available  computer  systems  on  the 
market  today.  Their  vast  potential  for  response  - even  with 
optimal  storage  and  search  algorithns  - has  very  ituch  a domant 
orientation.  Only  to  the  degree  that  the  right  questions  are 
asked  by  the  right  person  at  precisely  the  right  point  in  time 
does  this  passive  interactive  capability  support  the  decision 
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maker's  requirements.  An  alert  capability,  in  contrast  to  peis- 
sive  management  support  systans,  is  a concept  vAierein  threshold 
or  alarm  conditions,  initially  assigned  by  knowledgeable  C com- 
manders, are  continually  machine  monitored  and  coipared  with  the 
dynamic,  incoming  data  stream.  Alert  or  alarm  thresholds  (repre- 
senting a manager's  anticipation  of  an  iitpending  or  potential 
crisis  situaticai)  might  include  such  eventualities  as  the  buildijp 
of  enemy  forces  in  a given  zone,  excessive  downtime  of  friendly 
aircraft,  projected  unavailability  of  logistics  resoruces,  etc. 
Satisfaction  of  a predesignated  threshold  situation  can,  in  the 
Penn  design,  be  communicated  to  the  interested  user  through  such 
devices  as  terminal  print-outs,  print-outs  augmented  by  flashing 
lights,  the  sounding  of  bells  or  buzzers,  changes  in  the  color  of 
window  displays,  or  the  computer  generation  of  human  sounding 
speech  vocalizing  the  typewritten  alert  message,  or  calling  out  a 
warning  signal.  The  described  alert  capability  permits  the  indi- 
vidual user  to  dynamically  set,  shut  down,  or  reset  thresholds. 

Penn  has  also  created  a feedback  mechanisn  which  on  request 

could  inform  the  user  on  algoritlms  and  data  supporting  the  alarm 
sounding,  and  could  report  (through  directed  nenory  search)  on 
previous  actions  taken  by  other  managers  faced  with  the  same  or 
similar  alert  situations. 

Sif^xDrting,  driving,  and  facilitating  the  realization  of  the 
described  front  end  itan-machine  interactive  capabilities  is  the 
need  for  software  to  ensure  the  efficient  storage  and  retrieval 

of  data.  Certainly,  system  responsiveness  independent  of 

how  responsiveness  is  defined  is  directly  dependent  on  such 

issues  as  the  speed  cund  cctplet^ess  with  vhich  desired  informa- 
tion can  be  delivered.  Penn,  utilizing  techniques  frcm  its  cwn 

basic  research  program  and  borrcwing  frcm  others,  has  put  together 

2 

seme  innovative  software  ideas  for  the  ODA  C test  program. 

The  first  concept  that  I will  describe  is  the  autcmatic 
creation  of  "utility  files."  A utility  file  is  defined  as  a ten 
or  fifteen  percent  subset  of  a total  file  which  accounts  for  85 
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to  90%  of  the  interrogations.  The  ccmputer,  by  continuous  moni- 
torship  of  the  interrogation  stream,  defines  and  selects  out  for 
special  storage  those  data  which,  in  fact,  are  most  frequer.tly 
called  for.  Past  assesatients  of  logistics  and  C decision  sys- 
tems underscore  the  given  statistic  that  the  vast  majority  of 
user  questions  are  repetative,  and  can  be  answered  by  a snail 
fraction  of  the  full  file.  A significant  speed-up  in  information 
retrieval  is  possible  given  a system  vdiich  automatically  recog- 
nizes and  organizes  data  in  cognizance  with  this  phencmenon. 
Interrogations  are  directed  to  the  mini  file  rather  than  incur 
the  costs  of  runs  against  the  expanded  data  base. 

The  speeding  i:p  of  response  is  also  a promise  of  Penn's  de- 
sign of  a Data  Base  ftenagement  Systan  (DBMS)  vAiich  aiploys  notions 
taken  over  from  recent  developments  in  "relational"  data  file 
formatting.  In  this  case,  the  user  can,  for  exaitple,  more  instan- 
taneously up  and  down  a hierarchal  chain  of  system  relationships, 
eg. , a task  force  designation,  ships  and  aircraft  assigned  to  the 
task  force,  major  systems  related  to  the  ships  and  aircraft, 
equipments  contained  in  systems,  coiponents  contained  in  equip- 
ments, and  i>arts  embedded  in  coiponents.  The  user  can  ask  for 
and  get  quick  response  to  such  questions  as:  (1)  List  all  ships 
for  a piarticular  task  force,  (2)  List  all  ships  for  the  Task  Force 
on  idiich  a designated  radar  is  installed,  or  (3)  Provide  a list 
and  count  of  each  radar  type  on  a designated  task  force.  Conven- 
tional file  storage  techniques  require  cin  exhaustive  search  of 
the  total  ship/aircraft  configuration  file  to  provide  answers  to 
questions  of  this  kind. 

Lastly,  Penn's  DBMS  has  an  adaptive,  autcmatic  capacity  for 
reconfiguring  data  across  such  "spieed  of  retrieval"  sensitive 
storage  media  as  core,  disc,  drum  and  tape.  This  reconfiguration 
process,  affording  still  one  more  opportunity  for  inproved  cotpu- 
ter  responsiveness,  organized  and  reorganizes  files  based  on  such 
factors  as  the  use  of  statistical  algorithms  for  autonatically 
characterizing  the  interrogation  load,  the  employment  of  season- 
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ality  and  smaothing  factors,  and  the  incorporation  of  human  set 
priority  overrides. 

In  closing,  it  should  be  atphasized  tlat  the  described  cap- 
sbilities,  v^iile  available,  have  yet  to  be  tested  for  their 
applicability  and  suitability  to  the  Task  Force  environment. 
The  primary  purpose  of  the  Operational  DecisicMi  Aids  Program  is 
to  provide  quantitative  and  quatitative  measures  of  the  cost/ 
Efficiency  tradeoffs  across  aids,  and  to  explore  hisnan  factors 
issues  prior  to  real  vgorld  implementation. 

To  end  on  a positive  note,  it  appears  that  coiputational 
capabilities  already  on  the  shelf  make  possible  thie  dream  of 
tailoring  computer  system  to  sent  individual  needs  and  whims. 

The  range  of  possibilities  includes  interrogatioi  by  natural 
language  or  menu  selecticxi,  the  personal  designation  of  alerts 
or  thresholds,  split  screens  whose  contents  almost  nagically 
adjust  (messages,  alerts,  etc.)  at  the  call  of  each  user,  color 
coding  or  sound  signals  as  unique  output  or  personality  desig- 
nators. Whether  this  potnetial  capacity  for  both  having  our 
cake  and  eating  it  well  prove  to  be  too  rich  for  the  blood 
stream  is  an  inportant  question  for  ODA.  Fortunately,  we  are 
designing  the  COA  test  bed  to  answer  it. 
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ADAPTIVE  COMPLTTER-AIDHr)  DECISION  SYSTEMS 


by  GERSHCN  WELIWAN,  PH.D. 
PexccptA^onUci , Inc.,  WooMand  HWLi,,  ZaJU^OKi\-La. 


hWioducM.on  Most  systems  for  caimand  and  cc*itrol  have  as  their 
central  purpose  the  facilitaticai  of  tactical  decision  making,  and 
today,  tactical  operations  are  beconing  increasingly  sensitive  to 
decision  making  quality.  Large  stakes  rest  on  the  ability  of  per- 
sonnel to  request  and  to  process  volumes  of  infomation,  and  to 
make  rapid  and  effective  decisions.  Often,  the  decisions  are  made 
sequentially,  and  the  consequences  are  likely  to  affect  future 
choices.  Pertinent  exaitples  are  found  in  a variety  of  military 
and  non-military  systems.  Among  these  are  anti-submarine  warfare 
(ASM) , anti-air  operations,  shipboard  tactical  operations,  ooord- 
inaticn  of  electrcsiic  warfare  (EW) , control  of  ranotely  piloted 
vehicles,  environmental  surveillance,  crime  prevention,  and  air 
and  highway  traffic  control.  All  of  these  application  have  in 
cCTimon  changeable  decision  environments,  frequent  decision 
responses,  copious  but  fallible  information,  and  a minimum  of 
time  available  for  off-line  aids. 

The  human  decision  maker  (DM)  generally  performs  sub-opti- 
mally  under  such  conditions.  His  behavior  is  typified  by  cogni- 
tive limitatiOTis  on  memory,  attenticxi  and  processing,  and  biases 
and  inconsistencies  in  aggregating  information.  Accordingly, 
conputer  aiding  techniques  have  been  developed  to  iirprove  perfor- 
mance in  many  of  these  areas.  Ccmputer  aiding  can  unburden  the 
operator  of  routine  cciiputational  tasks,  assist  in  structuring  the 
decision,  perform  probability  assessnents,  and  call  attenticxi  to 
criticcil  events.  In  general,  these  techniques  have  been  applied 
to  static,  wall-defined  decision  situations,  using  off-line  modes 
of  interactic»i. 
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More  appropriate  for  the  tactical  case,  hcwever,  is  use  of 
the  cdtputer  to  respond  to  the  human  during  the  decision  making 
process  itself.  This  type  of  interactive  participation  requires 
cotputer  adaptation  to  changing  task  requirements  and  operator 
needs.  Also,  the  frequently  subjective,  incotpletely  quantified 
nature  of  real  world  decisions  may  necessitate  the  incorporation 
of  sore  form  of  a trainable  model  of  the  human  decision  maker, 
in  order  to  determine  his  preferences  and  goals.  Overall,  adap- 
tive coiputer  programs  can  provide: 

(1)  Generalized  goal-directed  system  behavior  in  environ- 
ments vdiich  cannot  be  predicted  in  advance, 

(2)  A functional  structure  for  modeling  processes  which 
cannot  be  defined  analytically,  but  which  allow  directed 
training  for  optimal  response, 

(3)  Autcmatic  system  performance  improvement  as  a function 
of  experience, 

(4)  Quick  adaptation  to  iflitediate  changes. 

Adaptive  Aiding  Concept  Figure  1 illustrates  the  generalized  form 
of  adaptive  decision  aiding  systems  investigated  by  Perceptronics 
over  the  past  five  years.  The  upper  part  of  the  diagram  shows  the 
usual  control  loop  of  the  hunan  decisicn  maker.  He  or  she  pro- 
cesses decision  information,  presented  on  sane  form  of  display, 
cind  makes  choices  which  both  affect  the  decisioi  environment  and 
alter  the  infonration  available  for  the  next  decision.  The  aiding 
system,  resident  in  a digital  conputer,  has  as  its  input  the  same 
decision  informaticn  available  to  the  human  operator,  as  well  as 
the  decisions  made  by  the  operator  on  the  basis  of  that  informa- 
tion. Using  adaptive  programs  and  normative  decision  criteria, 
the  coiputer  builds  a decision  model  of  the  decisicxr  naker,  and, 
by  means  of  interactive  display  programs,  provides  the  operator 
with  on-line  recannendaticns  based  on  his  own  preferences  and 
decision  strategy.  Later,  for  evaluation  or  training  purposes, 
the  ooiputer  provides  a performance  report,  in  which  decision 
making  effectiveness  can  be  separated  fran  the  actual,  probabilis- 


tic  consequences  of  the  decisicai. 

Concept  Implejmntation  A decision  svpport  system  termed  AIXJftM 
(Adaptive  Dynamic  Decision  Aiding  Methodology)  was  developed  in 
accord  with  the  above  concept.  ADDAM  consists  of  an  adaptive 
decision  model  which  continuously  observes  both  the  decision 
environment  and  the  DM's  behavior,  learns  his  decision  policy, 
and  itakes  decisicn  suggestions  based  on  the  apparent  value  of  the 
alternatives  to  the  decision  maker.  In  the  present  case,  the 
modeling  technique  is  based  on  the  prediction  of  decision  behav- 
ior according  to  maximum  expected  utility  (EU)  strategy.  In 
sinple  terms,  expected  utility  is  calculated  by  multiplying  the 
subjective  value  (utility)  of  a decision  outccme  by  its  probability 
of  occurrence.  Previous  investigators  liave  shown  that  the  EO 
model  is  oAust,  and  adequately  represents  hunan  decision  behavior 
in  a variety  of  circvmstaraes. 

The  adaptiveness  of  the  ADDAM  systen  is  realized  through  the 
use  of  a trainable  multi-category  pattern  classifier.  As  the  DM 
performs  the  decision  task,  this  on-line  estimator  observes  the 
operator's  choices  among  the  various  decision  options.  The 
estimator,  using  event  probabilities  as  ir^ts,  attearpts  to 
classify  these  probability  patterns  by  adjusting  utility  weights 
according  to  an  adaptive  error  correcting  algorithm.  In  this 
manner,  the  utility  estimator  tracks  the  operator's  decision 
ina)d.ng  and  learns  his  utilities.  Such  an  ajproach  has  a nimber 
of  advantages  ccnpared  to  off-line  utility  estimaticxi.  Dynamic 
estimaticxi  observes  and  models  actual  behavior  rather  than 
responses  to  hypothetical  decisions.  It  does  not  interrupt  or 
intrude  on  the  process  of  decisicxi  meUcing.  And  it  responds  to 
ongoing  chianges  in  task  ctiaracteristics  and  operator  needs. 

Projoably  the  easiest  way  to  describe  the  utility  estimation 
procedure  is  by  exaiiple.  For  instance,  a key  application  of 
ADDAM  is  in  intelligence  gathering.  Ifere,  the  dynamic  utility 
estimator,  shown  schematically  in  Figure  2,  classifies  pattern 
vectors 
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p = IPI,  1P2,  ...  kpi  ••• 

viiiose  ccxiponents,  j^Pj^,  are  a function  of  the  probability  that  an 

object  of  type  i is  present  and  the  reliability  k of  the  sensor 
used  to  detect  it.  These  probabilities  are  weighted  by  the  cor- 
responding utilities  of  object  sensing.  The  discriminant 

functions  are  then  the  expected  utilities  of  each  sensor  decision. 
The  utility  estimator  coiputes  the  EU  of  each  sensor  at  each  field 
location  and  selects  that  sensor  at  each  location  for  which  the  EU 
is  maximum.  The  sensor  selected  at  each  location  is  ccrpared  with 
the  actual  selection  made  by  the  operator,  and  if  they  differ,  the 
appropriate  utilities  are  rewarded  (increased)  or  punished  (de- 
creased) by  the  training  procedure.  Thus  the  utilities  are  train- 
ed to  characterize  the  operator's  judgmental  behavior  — i.e.,  to 
make  the  utility  estimator  respond  with  the  same  decisions  as  the 
opjerator.  A nore  detailed  explanation  of  the  learning  algorithm 
and  its  underlying  assiirptions  may  be  found  in  Davis,  Vfeisbrod, 
Freedy  and  Vfeltman  (1975) . 

The  characteristics  of  the  dynamic  utility  estimator  have 
been  evaluated  in  decision  contexts  which  include  a simulated 
fishing  fleet  surveillance  task  (Davis,  Vfeisbrod,  Freedy,  1976) , 
and  currently,  a simulation  of  anti-submarine  warfare.  In  all 
of  these  applicaticns,  the  estimates  of  multiple  dynamic  utilities 
typically  converged  r^idly  to  stable  and  distinct  values.  A 
representative  exaitple  of  the  behavior  is  given  in  Figure  3.  Here 
the  number  of  utility  adjustments  per  decision  is  graphied  as  a 
function  of  decision  cycles  for  a specific  utility.  Initially 
each  decision  results  in  a utility  adjustment.  Eventually, 
adjustment  is  made  only  about  one  in  ten  decisions.  There  appear 
to  be  two  stages  in  machine  adaptation:  (1)  a rapid  stage,  in 
which  the  major  protion  of  adaptation  is  made;  and  (2)  a gradual 
stage,  during  which  few  adjustments  take  place,  and  the  rv'  ;hine 
approaches  systematic  behavior.  In  this  typical  case,  major 


321 


adaptation  vras  ccitpleted  after  only  about  five  decision  cycles. 

Of  course,  convergence  to  stable  values  is  only  useful  if 
these  values  are  accurate  in  predicting  c^aerator  decisions. 

ADDAM  has  been  found  to  be  quite  effective  in  prediction,  with 
accuracies  ranging  frcm  75%  in  the  ccnputer  aided  training  task 
(May,  et  al,  1976)  to  95%  correct  predictions  in  the  simulated 
intelligence  gathering  task  (Davis,  Weisbrod,  Freedy,  and  Weltman, 
1975) . Additional  evidence  of  applicability  was  seen  in  the  high 
correlation  (.82,  p<.01)  ctoserved  betv^n  model-estimated  arxi 
operator-expressed  preferences  in  the  intelligence  task  (Weisbrod, 
Davis,  Freedy  and  Weltman,  1974) . 

AS(t/  SAjnuIaiion  Studif  Analysis  of  the  ADDAM  system,  and  of  its 
potential  applications,  led  to  a variety  of  questions  requiring 
experimental  validation.  Does  model-based  aiding  actually  work 
in  practical  situations?  Are  operators  able  to  exploit  the  aid- 
ing given  them?  Is  the  aiding  primarily  effective  in  iirproving 
decisicn  rate  or  decision  quality?  These  and  other  questions 
formed  the  basis  of  a full-scale  experimental  study.  The  inves- 
tigation was  organized  around  a realistic  ASW  task  simulation, 
highly  evocative  cf  actual  sutmarine  localization  and  tracking. 

The  simulation  derives  directly  frctn  tte  salient  features  of  ASW 
localization  and  tracking.  The  operator's  task  represents  an 
attarpt  to  capture  the  decision  making  processes  and  dynamic 
flavor  of  the  ASW  situation,  while  retaining  sane  degree  of 
experimental  rigor. 

In  brief,  the  simulation  involves  a single  ASW  operator, 
much  like  the  evaluator  in  a shipboard  CIC.  His  task  is  to 
track  the  movements  of  a hostile  sutmarine  and,  less  critically, 
a non~hostile  mobile  object  (a  vhale)  as  they  move  in  the  attack 
zone  preceding  an  aircraft  carrier.  The  attack  zone  is  formed  by 
a 5 by  5 grid,  where  each  grid  element  represents  approximately 
2.5  nautical  miles.  Neither  the  operator  nor  the  cotputer  aiding 
system  are  able  to  observe  directly  the  movements  of  the  sub- 
marine and  whale.  Their  only  access  to  the  environment  is  through 


sensors  which  the  operator  deploys  at  selected  grid  locations. 
These  sensors  differ  in  their  abilities  to  detect  different  types 
of  objects,  in  their  reliability,  and  in  their  cost.  A helicop- 
ter, for  exairple,  can  only  detect  a floating  sutitiarine,  and  has 
high  reliability.  A destroyer  can  detect  any  type  of  object,  also 
with  high  reliability,  but  is  more  costly  to  use.  Five  different 
types  of  sensors  are  available  in  all. 

The  operator  is  asked  to  monitor  the  movements  of  the  ASW 
target  elements  and  to  r^xart  their  locations.  To  acccrplish 
this,  he  deploys  the  available  sensors,  reads  their  outputs, 
reports  the  status  of  the  tracked  objects,  and  receives  the  prob- 
abilities of  their  next  location,  which  he  uses  to  make  his  next 
round  of  sensor  placements,  and  so  on.  He  can  also  receive  deci- 
sions aiding  generated  by  the  ADDAM  system.  Figure  4 schemati- 
cally diagrams  the  flow  of  information  between  the  DM  and  ADDAM. 
The  upper  locp  represents  the  main  flow  of  task  information.  The 
external  organization  block  represents  the  information  the  opera- 
tor brings  iiito  the  task,  i.e. , his  available  sensors,  "textbook" 
ASW  startegies,  organizaticxial  priorities,  etc.  Movements  of  the 
sutmarine  and  the  vrfiale,  the  results  of  sensor  deployments,  and 
production  of  the  parobability  Information  is  oontrolled  by  the 
real-vrorld  simulator  program,  v^ch  combines  conditional  action 
probabilities  (supplied  by  "experts"  on  sutmarine  and  whale 
behavior)  with  monte-carlo  selection  to  provide  a continuous 
stochastic  and  believable  ASW  scenario. 

The  lcR«r  loop  in  Figure  4 contains  the  decision  modeling 
and  aiding  functions.  Ihe  operator's  sensor  deployment  decisions 
and  the  intelligence  report  are  automatically  input  to  the  deci- 
sion model,  as  previously  discussed.  At  the  ejqjerimenter's  option, 
the  DM  rec::eives  decision  aiding  from  the  model.  Three  types  of 
decision  aiding  report  are  generated  by  ADDAM  during  the  course 
of  a decision  cycle.  They  are  described  belcjw  in  acoord  with 
their  order  in  the  task  secjuence. 
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(1)  Intelligence  Report.  This  report  is  derived  autcmati- 
caliy  from  the  operator's  status  report,  and  from 
"expert"  assessment  of  the  behavior  of  these  types  of 
objects.  ADDAM  assumes  that  the  cperator  has  correct- 
ly reported  the  location  and  heading  of  each  object, 
and,  by  aggregating  the  conditional  probabilities  of 
state  transformations,  makes  a Bayesian  estimate  of 
their  next  locaticxi.  The  intelligence  report  presents 
the  (non-zero)  prctebility  that  an  object  will  be  in  a 
sector  of  the  attack  zone. 

(2)  Sensor  Output  Evaluation.  This  report  has  the  sane  form 
as  the  intelligence  report.  However,  the  probabilities 
are  obtained  by  using  the  actual  sensor  outputs,  active 
or  non-active,  to  update  the  intelligence  report  prob- 
abilities according  to  Bayes'  Rule. 

(3)  Suggested  Sensor  Placanents.  This  report  is  based  upon 
the  adaptive  estimates  of  the  operator's  utilities  for 
information  received  frcm  each  type  of  sensor.  It  con- 
sists of  sensor  deployment  suggestions  v^ich  maximize 
the  evaluator ' s expected  utility  for  inf ortiation  gain . 

One  of  the  advantages  of  using  an  adaptive  decision  model  as 
the  basis  of  decision  aiding  is  the  extensive  performance  evalua- 
tion it  makes  possible.  Two  iitportant  types  of  performance  mea- 
sures are  directly  obtainable.  These  may  be  termed  (1)  decision 
outocane  measures,  indices  that  monitor  actual  decision  effective- 
ness, and  (2)  decision  quality  neasures,  reflecting  the  logical 
soundness  of  the  actions  prior  to  bcserving  the  consequences. 

Both  types  of  measure  were  eiqjloyed  in  the  present  study. 

VtCAyh  ion  Outcome  Outcone  measures  are  the  ones  typically  used  in 
evaluation  of  systan  performance.  Their  purpose  is  to  define 
performance  in  terms  of  objective,  readily-available  criteria  of 
cost  and  achievanent.  .They  focus  on  the  actual  outocane  of  an 
exercise,  and  include  such  variables  as  speed,  accuracy,  error 
rate  and  type,  costs,  etc.  In  the  present  case,  the  basic  per- 


formance  score  was  defined  as: 


r 


Sco^e  ' Gain  - coi  t 

where 

Goal  = Points  - Penaltiu 

PointA  were  credited  for  correct  location  reports,  and  PetyxLtieA 
were  deducted  for  incorrect  ones.  Co At  was  the  cost  of  sensor 
resources  allocated.  Operators  attenpted  to  maximize  their  score; 
score  feedback  showed  them  hew  they  were  doing  throughout  the  test 
session.  An  additional  outcone  measure  was  decision  througtput, 
defined  as  the  nanber  of  decision  cycles  ccirpleted  in  a test 
session. 

VzcAAion  QaaLLti]  In  the  long  run,  outceme  measures  are  the  true 
criteria  of  perfontance.  But  while  they  indicate  the  actual 
amount  of  goal  attainnent,  these  external  measures  seldom  identi- 
fy the  specific,  short-term  deficiencies  of  behavior.  Quality 
measures  are  used  to  evaluate  the  standard  of  decision  making 
regardless  of  outccite.  This  is  done  by  means  of  normative  criter- 
ia which  classify  the  decision  according  to  the  expected  outccres 
of  the  chosen  actions.  Such  performance  measures  are  extremely 
valuable,  because  in  aiding,  one  wishes  to  focus  on  the  decision 
before  its  result  is  determined  by  the  probabilistic  outside 
world  (Nickerson  and  Feehrer,  1975) . In  sore  cases,  correct 
decisions  have  poor  consequences,  while  poor  decisions  have  good 
outcomes.  The  main  quality  measure  used  in  the  present  study 
was  deviation  fretn  maximum  expected  utility  (DEU) . The  expected 
utility  of  a decision  is  cemposed  of  the  probability  weighted 
utilities  of  its  possible  outcomes.  If  the  probabilities  and 
utilities  involved  are  accurate,  the  DM  can  do  no  better  than 
pick  the  alternative  which  yields  the  maximum  expected  utility. 
Ccrplete  self-consistency  seldom  occurs, however,  and  even  though 
a decision  naker  exhibits  a stable  preference  structure,  any 
randomness  of  behavior  wall  result  in  a proportion  of  decisions 
which  are  suboptimal.  The  extent  of  suboptimality  may  be  mea- 
sured by  calculating  the  average  difference  in  expected  utility 
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between  the  optimally  derived  and  the  actually  chosen  alternative. 

A group  of  twelve  operator  subjects  participated  in  tiie  study. 

They  came  fron  the  local  Air  National  Guard  center,  were  equally 
divided  betveen  CD's  and  NCO's,  and  were  well  representative  of 
military  personnel  who  might  interact  with  future  ccnputer-aided 
command  systems.  Half  were  assigned  to  an  aided  group  and  half 
to  an  unaided  (control)  group.  Unaided  operators  worJced  alone, 
using  only  the  ccriputer-generated  intelligence  reports  during  taslc 
execution.  Aided  operators  received  additional  ccmputer  assist- 
ance in  the  form  of  sensor  output  evaluation,  and  sensor  place- 
mait  reconmendations.  Following  two  practice  sessions,  during 
vhich  the  operator's  utilities  were  learned  by  the  aiding  systan, 

performance  was  recorded  in  a 1-1/2  hour  test  session.  ; 

Table  I sumnarizes  the  experimental  results.  The  data  show- 
ed that  the  aided  groip  performed  significantly  better  than  the 
control  group  (P<.f)5),  jiiproving  their  mean  score  by  almost  a 
factor  of  two  (88%) . Inprovement  was  partially  attributed  to  a 

small  but  significant  increase  in  the  number  of  decision  trials  , 

conpleted  during  the  session.  But  most  of  it  appeared  due  to 
the  better  overall  quality  of  the  aided  decisions.  That  is,  tfie 
aided  operators  incurred  slightly  higher  sensor  costs,  but 
received  a much  greater  return  in  points,  and  a substantially 
lower  number  of  penalties.  Decision  consistency,  as  measured  by 
mean  deviation  fron  maximum  expected  utility,  was  also  signifi- 
cantly (P<.05)  enhanced  for  the  aided  group. 

It  is  interesting  to  note  that  besides  obtaining  almost  twice  ' 

the  score  of  the  control  group,  the  aided  groip  displayed  con- 
siderably less  variability  among  subjects.  This  intersubject  con- 
sistency is  evident  fron  the  difference  in  standard  deviation 
(40.2  aided  versus  64.9  control)  and  afpears  even  more  pronounced 
when  the  coefficients  of  variation  are  ccmpared.  The  coefficient 
of  variation  is  defined  as  100  times  the  standard  deviation  divided 
loy  the  mean;  its  purpose  is  to  normalize  for  the  size  of  the  mean. 

The  calculated  values  are  24.9  for  the  aided  group  versus  132.8 
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for  the  control  groi^,  representing  an  imporvement  ratio  of  over 
five  to  one. 

ConciiiS-ion-i  The  conbination  of  probability  aggregation,  adaptive 
utility  nodeling,  and  normative  decision  recomendation  described 
here  appears  well  suited  to  the  coiplexities  of  tactical  decision 
aiding.  As  inplanented  and  evaluated  in  the  ADDAM  system,  tlese 
techniques  responded  to  differences  in  decision  style  and  to 
changes  in  task  circunstances , they  supplied  a variety  of  aiding 
information,  and  provided  a framework  for  analyzing  and  connuni- 
cating  the  rationale  for  decisions  to  tte  decision  maker.  All  in 
all,  the  adaptive  systan  became  an  interactive  "staff  aide"  to 
the  decision  maker.  As  such,  it  was  accepted  without  problem  by 
the  operator  subjects,  in  great  part  because  it  actually  reflec- 
ted the  individual's  preferences  and  style. 

Much  of  the  significance  of  this  work  lies  in  its  incorpor- 
ation of  both  descriptive  and  normative  aspects  of  decision 
analysis  into  a single  system.  The  descriptive  modeling  is  inter- 
nally validating  through  prediction  of  behavior,  while  the  norma- 
tive recotmendations  represent  a processing  of  new  irputs  in 
accord  with  the  same  previously  observed  behavior.  Thus,  the 
operator's  decision  policy  cannot  only  be  captured  and  analyzed, 
tut  can  be  used  to  systematically  reduce  sane  of  the  cognitive 
effort  of  processing  new  problans.  Operator  consistency  tends  to 
inprove,  since  the  aiding  systan  incorporates  a more  representa- 
tive sample  of  behavior  than  the  person  normally  considers,  and 
actions  are  structured  more  carefully,  according  to  optimal 
rules.  Finally,  the  technique  is  carputationally  parsimonious. 
Only  those  structural  aspects  necessary  for  capturing  the  opera- 
tor's behavior  are  included,  much  as  pattern  recognition  techni- 
ques normally  require  only  a snail  portion  of  the  structure 
required  by  complete  dynamic  models. 

Analysis  indicates  that  the  donain  of  greatest  premise  for 
adaptive  decision  aiding  lies  in  areas  of  high  time  and  load 
stress,  where  there  is  a reliance  on  changing,  subjectively  deter- 
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mined  criteria  of  performance.  Also,  a basic  structuring  of  the 
decision  task  and  seme  degree  of  recurrent  behavior  is  necessary 
for  the  continuing  estimation  of  model  paraneters.  In  circun- 
stances  that  do  not  satisfy  these  conditions,  the  adaptive  systan 
can  work  with  a variety  of  other  analysis  modes,  acting  as  part 
of  a decision  support  system  similar  to  that  envisioned  by  Leavit, 
Alden,  Erickson  and  Heaton  (1974) . For  instance,  long  range 
planning  nay  be  best  done  using  tree  elicitation  and  structuring 
(Brown,  Hoblitzell,  Peterson  and  Ulvila,  1974;  Nickerson  and 
Feehrer,  1975) , while  corpletely  formulated  and  specified  prob- 
lems benefit  strongly  fron  the  rapidity  of  decisions  rules  or 
preprogramned  responses  (Brown,  et  al,  1974).  Adaptive  programs 
carbine  readily  with  and  carplanent  these  types  of  aids,  so  that 
a major  protion  of  decision-naking,  fron  problem  formulation  to 
performance  evaluation,  can  potentially  be  supf  >rted. 
Ackiioioledgmciit  The  work  reported  here  was  supported  by  the 
Cybernetics  Technology  Office  of  ARPA,  and  monitored  lay  the 
Engineering  Psychology  Branch  of  C*®  under  Contract  Number 
N00014-73-C-0286. 


328 


i 

1 


Table 

1.  MEANS 

AND  STANDARD  DEVIATIONS 

FOR  THE 

TWO  GROUPS  CW  THE 

PERFORMANCE  MEASURES 

MEASURE 

AIDING 

CONTROL 

TEST 

NUMBER  OF 

X 

43.0 

37.5 

p.  .05 

DECISION 

t test. 

CYCLES 

SD 

3.1 

4.6 

10  df 

POINTS 

X 

290.0 

224.3 

p<.05 
t test, 

SD 

28.7 

50.3 

10  df 

PENALTIES 

X 

63.7 

77.8 

SD 

8.7 

18.2 

COST  OF 

X 

68.8 

61.2 

SENSORS 

SD 

8.7 

18.2 

SCORE 

X 

161.8 

86.2 

p<.05 
t test. 

SD 

40.2 

64.9 

10  df 

DEU 

X 

1307.5 

2642.2 

p<.05 

FYnax  test. 

SD 

772.2 

2471.4 

5 df 
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Discussiai 


Lt.  Col.  Geesey:  Can  you  give  us  sane  sort  of  feel  for  the  state 
of  understanding  the  theory  for  that  kind  of  decision  making  pro- 
cess. It  appears  to  be  a linear  type  of  structure.  Perhaps  the 
gentlemen  here  are  more  familiar  with  it  than  I am.  But  I would 
appreciate  it  if  you  would  sort  of  carrent  on  that  state  of  theory 
with  that  sort  of  adaptive  process. 

Weltman:  I wish  I can,  this  is  going  to  sound  like  my  partner  and 
I know  everything  in  the  world  and  that  is  one  of  the  things  he 
knows.  I would  be  glad  to  send  you  our  reports.  Dr.  /Snos  Freedy 
who  sometimes  gives  the  same  presentation  of  results  and  couldn't 
make  it  to  this  meeting,  is  the  one  who  deals  with  the  theoretical 
aspjects.  It's  not  a put-off,  but  anything  that  I wDuld  say  would 
be  at  such  a low  level  that  it  wouldn't  help  you,  but  if  you  give 
me  a card  I wall  send  you  a papjer  that  will  explain  sane  of  the 
theoretical  applications. 

Geesey:  The  purpose  of  my  questicn  really  was  to  point  out  the 
fact  that  the  decision  makers  who  work  wath  this  kind  of  system 
also  have  to  understand  this  kind  of  structure. 

Weltman:  Well  on  the  very  sirrplest  basis  I would  say  yes.  Lot's 
go  to  the  very  sinplest  thing.  We  ran  one  experiment  which  was 
interesting.  In  one  case  we  told  the  decision  makers  where  the 
reconnendation  were  caning  fron,  that,  in  fact,  they  were  coming 
fron  a process  which  was  based  on  their  cwn  previous  performance. 
In  the  other  case  we  did  not  tell  than,  but  we  gave  them  the  same 
recormendations.  The  ores  who  knew  that  they  were  their  owm 
preference  used  them  and  improved  their  performance  significantly 


have  to  find  out.  But,  because  of  this  perhaps  we  have  seen 
virtually  no  resistence  in  this.  We  are  usir*g  subjects  we  are 
paying  them  so  one  doesn't  expect  it.  On  the  other  hand,  they 
are  not  obligated  to  us.  They  don't  work  for  us.  They  can  tell 
us  anything  they  want  and  they  are  fully  representative  of  the 
type  of  people  who  use  such  systems.  In  fact,  they  enjoy  it.  I 
mean  as  I said,  I wasn't  being  facetious  about  having  a staff 
member.  That  for  me  ccming  at  it  frcrn  the  technology  side,  I 
see  ccrputations  as  a staff  mamber.  I also  see  fun  of  ownership. 

I mean  the  same  fun  people  get  from  discussing  hot  cars  people 
get  frcm  discussing  hot  conputers  if  they  know  scmething  about 
it.  To  me  it  is  a question  of  proper  indoctrinaticn  and  the  use 
of  it  doesn't  have  to  be  frightening  and  can  really  be  quite 
pleasant. 

Bonder:  Let  me  see  if  I understand  what  you  are  doing.  This  is 
not  a model  of  decision  making.  You  are  not  getting  an  adaptive 
model  of  the  decision  maker.  You  are  adaptively  learning  about 
his  utilities.  There  is  an  underlying  assumation  of  a Bayesian 
decision  maker.  He  is  a Bayes  decision  maker.  He  acts  out  what 
is  expected  of  him. 

Wbltnan:  As  I said,  this  is  the  basis  on  which  we  make  our 
initial  prediction.  If  that  prediction  falls  down,  then  we  are 
in  fact  not  modeling  that  decision  maker  whatsoever. 

Bonder:  If  a man  is  not  truly  a Bayes  decision  maker  these  will 
not  converge.  Is  tliat  correct? 

Weltman:  If  he  is  not  acting  in  accord  wath  his  utilities. 
Remannber  scmebody  said  this  morning  that  a model  is  an  abstrac- 
tion. I am  not  going  to  stand  up  here  and  argue  that  people  are 
in  fact  maximizing  utility.  In  so  far  as  we  can  predict  the 
decisions  in  a situation  which  we  can  define,  yes  we  have  modelled 
decision  mkers. 

Bonder:  My  question  is:  If  that  is  true,  then  should  we  use  it 
to  train?  If  sctneone  is  not  a Bayes  decision  maker,  do  you  want 
to  make  hum  one? 
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Weltman:  That  is  a political  decision,  but  yes,  if  you  do.  I 
vould  say  as  opposed  to  irrational  choices,  yes  I think  I would. 
Sanebody  else  might  want  to  train  them  to  be  a different  type  of 
decision  maker  is  what  you  are  saying? 

Bonder;  No,  no,  I am  just  asking  questicMis.  I am  trying  to 
understand  what  you  are  saying  - you  are  saying  that  I am  only 
rational  if  I am  a Bayes  decision  maker? 

I Weltman:  No,  I didn't  say  that.  You  asked  that  should  we  try 

! to  train  them  to  be  this  type  of  decision  maker.  Yes,  I see 

: great  value  on  certain  circunstances.  For  exanple,  in  the 

! maintenance  work  that  we  cure  doing,  typical  maintenance  is  not 

j taught  now  as  a judgment  between  risk  and  benefit.  It's  taught 

I on  other  means.  New,  by  means  of  these  types  of  models,  we  in 

I fact  teach  them  that  a decision  to  make  a trial  measurarent  is  a 

} 

! choice  between  the  benefits  of  that  measurement  and  the  cost  of 

I that  measurement.  The  fact  that  we  use  this  particular  model  is 

helpful  and  is  opportune.  But,  yes,  in  nany  situations  I would 
say  it  is  reasonable  to  train  people  to  make  choices  on  this 
type  of  a basis. 

I , Bonder:  The  question  is : Suppose  I would  use  the  model  and  in- 

• stead  of  making  him  a Bayes  decision  maker,  I would  make  him  an 

M aspiration  level  decisicn  maker.  I would  only  pick  those  actions 

► that  maximize  seme  probability  of  an  event  occurring  as  opposed 

to  maximizing  expjected  return? 

Weltman:  That's  why  I said  it  was  a political  decision.  You 
have  to  choose  it  on  sane  basis.  Whatever  appeals  to  you  and  go 
ahead  on  that  basis.  I don't  knew  if  cne  has  tested  models  in 
that  same  situation.  You  could  certainly  do  that  also  and  choose. 
Of  course,  v^t  basis  would  you  choose  the  models? 
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AN  ARGUMENT  TOR  EX)RTIFIED  DEFENSE  IN  WESTERN  EUROPE* 


by  JAMES  R.  THOMPSCN 

Rice  UnUvzu^y 


Having  urged  for  the  development  of  an  applied  mat.oanatical 
approach  for  DOD  problems  vdiich  takes  its  axioms  from  military 
history,  I give  a sinple  exanple.  Let  there  be  two  sides  - the 
Blue  and  the  Red  - with  strengths  u and  v.  Consider  the  case 
where  u and  v are  lunped  scalar  rather  than  vector  quantities. 
Frequently,  the  model  proposed  for  a combat  between  the  two  sides 
is  Lanchester's  first  law. 


du 

dt 


-Cj^V 


dv 


(1) 


This  system  has  the  solution  as  functions  of  time  and  initial 
force  strengths 


u(Uo,v^,t)  = Uq  coshv6^2  t ” 
v(Ug,v^,t)  = v^  coshv6^2  t - 


sinhv€^2 


— sinhvSIc 


12 


t 


t . 


(2) 


A more  ccitiTon  expression  for  the  solution  is 

c. 


u 


r.2  -1,2 

u = (v 

o *-2 


(3) 


and  u and  v are  considered  to  be  at  ccmbdt  parity  with  each 
other  if 


u 


2 


(4) 


* Sipported  by  STAG  Contract  nAAB09-71-R-0063  and  ONR  Grant 
NR042-283. 
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Expression  (4)  has  caused  some  concern  among  military 
strategists  in  their  consideration  of  the  outccme  of  a possible 
European  war  between  NMD  and  the  Warsaw  Pact,  for  by  (4)  if  u* 
and  V*  are  parity  strengths  and  the  Red  forces  can  actually 
achieve  the  level  v = kv*  (with  k > 1)  against  a Blue  force 
u = u*,  then  sonehow  the  Blue  forces  must  achieve  a new  cl  with 


^2  ^ *^*^1  Blue  is  to  win  the  conflict.  In  reality,  the  Euro- 
pean situation  v^ould  surely  give  the  Warsaw  Pact  a value  of  v 
with  k > 1,  and  NMD  weapons  technology  would  probably  be  hard 


pressed  to  obtain  a weapons  effectiveness  k 
Russians.  Hence,  the  cause  for  concern. 


times  that  of  the 


An  alternative  strategy  for  Blue  would  be  to  lower  c,  to 


so  that  C2  > k 


It  is  this  approach  which  is  advocated 


in  this  note. 

Ever  since  the  abysmal  failure  of  the  Maginot  Line  in  1940, 
it  has  more  or  less  been  taken  as  obvious  that  fixed  defense  is 
the  strategy  of  failure.  We  would  question  this  view.  Histori- 
cally fixed  defenses  have  proved  more  effective  as  conpact  islands 
of  resistance,  rather  than  as  wide  dikes  to  hold  back  the  enemy 
tide.  The  ^teginot  Line  was  clearly  designed  as  a dike,  as  was 
the  Great  Wall  of  China,  and  both  proved  failures.  It  is  perhaps 
unfortunate  that  the  dike-like  tactics  of  trench  warfare  had 
proved  so  effective  in  World  War  I.  Otherwise,  the  French  would 
undoubtedly  have  noted  that  they  were  basing  their  1940  defense 
on  an  historically  fragile  strategy.  Dikes  generally  can  with- 
stand force  only  frctn  the  front,  as  the  Persians  (finally)  dis- 
covered at  Thermopolae.  If  the  dikes  are  sufficiently  narrow 
and  thick,  however,  they  may  be  effective  islands  and  very  diff- 
icult to  overwhelm.  It  was  conceded  by  a number  of  the  great 
panzer  innovators  - e.g.,  von  Manstein  - that  Germany  absolutely 
could  not  have  taken  the  Sudetenland  defenses  in  1938. 
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The  type  of  fortified  defense  advocated  here  is  not  that  of 
the  dike,  but  tliat  of  the  archipelago  of  islands.  There  is  a 
natural  tendency  to  scoff  at  \Amt  appears  to  be  an  advocacy  of 
the  construction  of  "castles"  in  the  Twentieth  Century.  In  spite 
of  the  tendency  of  sore  to  denounce  every  military  precedent  over 
twenty  years  old  as  obsolete,  we  give  below  a few  historical 
examples  of  "castle"  defense. 

In  the  books  of  the  Maccabees  in  the  Old  Testament,  we  have 
examples  of  Seleucid  defenders  of  the  castle  in  Jerusalem  holding 
out  against  the  Hebrews  for  whole  years,  after  all  Seleucid 
armies  in  Palestine  had  been  defeated,  until  relieved  by  later 
expeditionary  forces.  Tyre  is,  of  course,  a natural  island 
castle  and  vten  defended  as  such  has  proved  almost  impossible  to 
take. 

Among  the  crusading  orders,  the  Tenplars  and  Hospitalers 
early  discovered  they  could  maintain  an  effective  Christian  pre- 
sence in  the  Near  East  only  by  concentrating  a large  percentage 
of  their  forces  in  a number  of  strongly  fortified  castles.  Most 
of  the  military  disasters  to  the  orders  were  the  result  of  their 
frequent  willingness  to  strip  their  castle  defenses  and  join  the 
crusader  barons  in  massive  land  battles  - as  at  Hattin.  It  is 
interesting  to  note  that  one  of  the  crusader  foirtresses  - Malta  - 
never  fell  to  the  Muslims  and  was  only  taken  (by  treachery)  by 
Napoleon  in  1798.  In  the  Second  World  War,  the  connection  (ae- 
tween  the  resistance  of  Malta  and  the  destruction  of  Rcrmel's 
Mrika  Corps  is  well  remeirbered. 

Among  recent  exanples  of  defense  efforts  of  the  "castle" 
variety,  the  defense  of  Westerplatte  in  September,  1939,  by  a 
reinforced  Polish  weapons  company  against  a German  army  with 
tanks  plus  artillery  plus  aircraft  plus  a battleship  for  a full 
week  is  notable.  It  would  be  instructive  to  ccnpute  the  Lan- 
chester  coefficients  for  this  particular  engagement. 

As  an  exanple  of  castle  defense  vhich  was  seriously  preposed 
but  never  executed,  we  have  the  famous  national  redoubt  plan 
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advocated  by  manbers  of  Hitler's  staff.  Had  a nunter  of  well 
provisioned  citadels,  manned  by  a few  divisions  of  Waffen  SS, 
been  placed  in  the  Bavarian  and  Austrian  Alps,  it  is  interesting 
to  conjecture  how  long  they  might  have  held  out  and  at  what  cost 
to  the  Allies. 

Still  more  recently,  we  have  the  exanple  of  "castle"  defense 
by  Vietnamese  units  positioned  in  strategic  hamlets.  Their 
function  was  to  maintain  a government  presence  - even  if  the 
hamlet  should  be  overrun  - until  such  time  as  reinforcanents 
were  brought  in  frcm  outside.  The  number  of  hamlets  which  were 
transformed  fron  de  facto  Viet  Cong  control  to  ARVIN  control  by 
this  device  was  quite  significant. 

In  the  exanples  above,  there  seem  to  be  sons  catmon  points. 
Fist  of  all,  fortified  defense  gives  a ready  means  of  increasing 
the  ratio  of  the  Lanchester  coefficients  in  favor  of  the  Blue 
side.  One  natural  advantage  to  this  type  of  defense  is  the  fact 
that  the  defender  can  increase  his  lanchester  attrition  coeffi- 
cient against  a potential  agressor  by  a policy  of  construction 
over  a period  of  years.  This  may  be  a more  fruitful  policy  than 
placing  all  one's  hopes  on  increasing  ones  Lanchester  coefficient 
solely  by  the  design  of  new  weapons  systems.  Historically,  of 
course,  defense  effectiveness  has  been  increased  more  often  by 
fortress  design  than  by  weapon  innovation. 

Secondly,  fortified  defense  should  rely  on  adequate  stores 
of  supplies  located  within  the  "fortress"  perimeter.  It  should 
be  assuned  by  the  defenders  that  they  will  be  ccrpletely  sur- 
rounded by  the  enemy  for  long  periods  of  time.  (In  their  for- 
tress at  Magdeburg,  the  Teutonic  Knights  always  kept  at  least  10 
years  provisions.) 

Thirdly,  fortified  defense  is  a task  best  undertaken  by  well 
trained  professionals  with  strong  group  loyalty. 

Fourthly,  fortified  defense  is  most  effective  when  there  are 
allied  eirmies  or  potential  allied  armies  poised  to  strike  the 
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enemy  at  sane  future  time  and  place.  The  fortress  and  the  mobile 
striking  force  ccnplement  each  other  in  their  functions.  The 
function  of  the  fortress  is  to  punish,  harass  and  divide  the 
enemy  and  to  maintain  a presence  in  a particular  area.  In  gen- 
eral, however,  offensive  activities  must  be  left  to  the  mobile 
forces.  The  deployment  of  enany  forces  to  take  fortified  posi- 
tions will  weaken  their  ability  to  withstand  nobile  offensive 
operations. 

Let  us  now  examine  the  preceding  argvsnents  in  the  context  of 
the  equations  (1) , where  now  we  consider  cj^  to  be  variable.  We 

assvine  that  by  the  skillful  construction  of  "island"  defenses  the 
Blue  side  may  chtain  a relation  of  the  form  c^  = f(u,v)  which 

is  described  graphically  in  Figure  (1).  We  assune  that  f(u,v) 
never  exceeds  c^^,  the  attrition  constant  corresponding  to  non- 
fortified  conbat. 


V > V > V > 
1 2 3 


Figure  1 


clearly  the  function  f and  the  value  of  the  attrition  con- 


stant are  functions  of  the  manner  in  viiich  the  fortress  has 

been  constructed.  It  nay  be  desirable  to  design  the  fortress  so 
that  c|  is  small  even  at  the  expense  of  decreasing  c^.  Gener- 
ally, one  might  assume  that  c^  is  close  to  the  nonfortified 

attrition  rate  of  u against  v,  since  the  defenders  will  have 
removed  potential  cover  for  the  Red  side.  In  fortress  defense, 
the  solution  in  (2) , vrfiich  involves  time  as  a variable  is  likely 
to  be  inportant,  since  a primary  objective  is  to  maintain  a pre- 
sence for  as  long  as  possible. 

Let  us  consider  a reasonable  first  approximation  to  the 
V- level  curves  of  f. 

In  Figure  (2)  we  show  linear  segment  approximations  to 
f(.,  v)  for  various  values  of  v. 


Here,  in  the  u range  (vdiich  is  where  ve  could  expject  most 
fortress  defense  to  take  place)  we  would  have 
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(5) 


= -g(v)uv  - c*u 

\«tere  f(u,v)  = g(v)u,  and  cj  is  the  Blue  coefficient  of  internal 

attrition.  We  might  reasonably  expect  that  the  besieging  forces 
woiild  maintain  more  or  less  a constant  number  of  troops  in  the 
vicinity  of  the  redoubt.  Hence  we  would  e:q3ect 

^ = -c^u  - c^v  + P(u)  = 0.  (6) 


where  P(u)  is  the  rate  of  replacement  necessary  to  maintain 
constant  u strength  and  c^  is  the  Red  ooefficient  of  internal 

attrition.  We  might  expect  that  c^  >>  cj,  since  inadvertent 

self-inflicted  casualties  are  a well  known  problem  for  the  be- 
sieging force.  Then 

u = u^  exp[-(g(v)u  + cj)t].  (7) 


The  enemy  attrition  at  time  t is  given  by 
t CoU_ 


/ P(u)dT  = c*tv  + 1 1-exp [-t(g(v)v  + cj)  ] } 


(8) 


If  the  Blue  defense  can  hold  out  until  u 


au^  (vtere  0 < a < 1, 


possibly  a = .1) , then  the  time  till  the  end  of  resistance  is 
given  by  t*  = . We  have,  then,  that  the  total  losses 

to  the  Red  side  by  the  time  the  defense  falls  is  given  by 

[c^Uo(l-a)  - c*v  In  a]  . (9) 


It  is  interesting  to  note  that  if  c*  = 0,  then  the  minimization 

of  Red  casualties  is  consistent  with  the  minimization  of  t*. 
This  might  indicate  that  an  optimum  strategy  for  Red  is  to  over- 
whelm the  Blue  fortifications  by  shear  weight  of  numbers.  This 
would  not  be  true  if  beyond  sane  value  of  v,  (g(v)v)  ^ 0, 

iitplying  that  beyond  a certain  strength,  additional  Red  forces 
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would  actually  inpair  Red's  ability  to  ’nflict  casualties  on  the 
Blue  side.  As  a matter  of  fact,  the  history  of  fortified  defense 
seems  to  indicate  that  such  a "beyinning  of  negative  returns" 
point  in  the  v space  does  exist.  Moreover,  so  far  frcm  being 
zero,  it  is  generally  the  case  for  the  besieging  force  that 
c^  >>  0.  This  is  particularly  true  if  the  besieged  forces  are 

able  from  time  to  time  to  conduct  carefully  planned  sorties  in 
order  to  encourage  increased  confusion  and  trigger  happiness  on 
the  part  of  the  besiegers. 

Under  the  same  assunptions  as  given  above  ve  have  in  the 

case,  vtere  the  Blue  and  Red  forces  have  strengths 

u=  (u.  ,u,,...,u  ) and  v=  (v  ,v  , ...,v): 
i z m 1 z n 

du  • n 

37^  = - y k..(v.)v,u.  - k*u. , j = 1,2, ...  ,m 
dt  1]'  1 1 3 D 1 


av.  lu 

= - y £. .u.  - -C^v.  + p. 
dt  31  3 11  1 


(u)  = 0,  i = 1,2, . . . ,n. 


This  gives 


= u.  (0)  exp[~t(  y k (v.  + k!j)] 
J J J -1-J  -*■  J 


3 3 “ 1]  ' 1 3 ' 

The  total  attrition  to  the  ith  enemy  siabforce  at  time  t is 

t m t n 

/ P (u)dT  = y 1. .u. (0)/exp[-t(  y k. .(v.)v  + k*) Idx  + ijtv.  (12) 
o ^ j=l  J o j=l  J ^ 

m £ . -u ■ (0) 

= J,  lk..(v-)v.tk*  {l-exp[-tlk  (v.)v.]}  + IJtv 
3=1  13  1 1 3 


Suppose  that  the  effectiveness  (at  time  t)  of  the  defender  is 
measured  by 

m 

T(t)  = y a.u  , (1 

j=l  3 3 


J 


1 


where  the  are  predetermned  relative  effectiveness  constants. 

If  we  assume  that  the  fortress  is  lost  when  the  effectiveness  is 
reduced  to  seme  fraction  a of  its  initial  value,  i.e. , \dien 

T(t)  < aT{0)  , (14) 


then  we  can  use  (11)  to  solve  for  the  time  of  capture. 

The  above  model  has  been  designed  to  shew  hew  attrition  might 
proceed  during  a fortified  defense.  Because  of  the  rapid  advance 
in  technology  over  the  past  fifty  years,  military  planners  have 
tended  to  rely  almost  ceitpletely  on  weapons  systems  technology  to 
increase  combat  effectiveness.  Vfe  suggest  that  a certain  amount 
of  effort  should  be  expended  in  an  investigation  of  the  older 
procedure  for  increasing  effectiveness  - namely,  fortification. 

This  is  particularly  true  when  the  United  States  is  being 
opposed,  as  in  Europe,  by  an  aggressive  power  with  great  strength 
both  in  itenpewer  and  in  weapons  technology. 

Of  course,  everything  in  defense  planning  must  be  done  in 
the  shadow  of  atomic  vreapons.  It  is  true  tliat  fixed  defenses 
could  iDe  destrxayed  by  sufficiently  large  nuclear  warheads  - just 
as  could  any  city  or  military  base  on  earth.  However,  the  use  of 
nuclear  weapons  against  military  installations  is  well  up  the 
rungs  of  the  escallaticn  ladder.  If  the  Soviets  would  lae  willing 
to  use  such  devices  in  Europe,  they  would  understand  the  order  of 
magnitude  of  the  ris]r  they  ran.  One  might  use  the  argument,  "Yes, 
we  could  construct  hard  defenses  in  Europe,  but  if  the  Russians 
found  they  could  not  take  them  except  by  nuclear  weapons,  they 
would  use  nuclear  weapons."  But  this  more  or  less  presupposes  a 
situation  in  vAiich  the  Russians  would  take  Europe,  or  else.  In 
such  a case,  the  United  States  has  its  own  nuclear  weapons. 

NKTO,  however,  is  primarily  designed  to  be  effective  for 
scenarios  lower  down  the  escallaticn  ladder.  At  the  present 
time,  an  invasicn  of  Western  Europe  by  the  Warsaw  Pact  would 
quite  likely  force  the  United  States  either  into  a nuclear  exchange 
or  into  a costly  fighting  retreat  followed  ioy  negotiations  leading 
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to  the  taking  of  sane  or  all  of  Vfestem  Europe  into  the  Soviet 
sphere.  The  establishment  of  a number  of  NATO  redoubts  would 
give  NATO  time  to  asnsider  the  situation  and  apply  cxjunter- 
pressures  in  an  optinalfeshion. 

In  conclusion,  I am  very  much  aware  of  the  existence  of 
defects  in  the  above  model.  The  mathematics  are  quite  sinple, 
going  back  at  lecist  to  Kelvin's  kinetic  theory.  The  point  is 
that  the  approach  was  motivated  by  historical  data  and  that  the 
nodel  was  not  a warmed-over  business  case-study.  If  applied 
mathematics  is  to  play  any  useful  part  in  the  development  of 
strategy  and  tactics,  then  it  is  essential  that  our  model- 
building approaches  be  developed  in  cooperation  with  the  intui- 
tive knowledge  of  Ccireer  officers  and  in  the  light  of  military 
history. 
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COWENTS  ON  PROPEUSIONS  IN  MATHEMATICAL  MODELLING 


by  THOEftS  G.  HALUVM 
U>u.ve,u-iXy  of,  Gzuxgia 
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In  respcBise  to  the  invitation  to  participate  in  this  systems 
groif)  discussion,  I claimed  personal  ignorance  in  the  area  of 
modelling  tactical  control  and  caimand.  When  the  retort  to  this 
concern  indicated  a need  for  external  participation,  I accepted 
because  present  interests,  plankton  models,  eue  probably  as 
"external"  as  one  can  get.  The  following  philosophical  ccmnents 
should  be  evaluated  from  tlds  exogeneous  perspective. 

1.0  A Suggestion  ^o-'i  QiiaJLiXativz  Stadiu.  A modelling  perspec- 
tive which,  in  my  opinion,  has  not  been  sufficiently  aiphasized 
at  this  workshop  is  the  qualitative  aspect.  I shall  make  a few 
conments  on  mathematical  modelling  in  general  and  the  qualitative 
^proach  in  particular. 

Mathematical  modelling  by  its  nature  is  interdisciplinary. . . 
to  be  interdisciplinary  one  must  first  be  disciplinary  in  two  or 
more  subjects.  Major  modelling  problams  can,  and  undoubtedly 
have  arisen  in  a subject  as  complex  as  co»itrol  and  comand  primar- 
ily because  there  are  ajparently  few  experts  sufficiently  knowl- 
edgeable  in  the  mechanics  of  C and  also  sufficiently  proficient 
in  mathanatics  to  handle  the  problems.  The  need  for  training  such 
experts  is  great  and  several  good  suggestions  along  this  line  have 
been  proposed  by  Professor  Kalaba. 

2.0  The  ModeZting  P-ToceAA.  The  flow  chart  in  Figure  1 is  a skele- 
ton schematic  representation  of  the  modelling  process.  I shall 
now  discass  some  of  the  cxrponents  in  the  diagram. 
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Figure  1 

A SchEsnatic  Representation  of  the  Modelling  Process 
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Laws  of  Nature.  No  madel  of  a phenonenon  will  be  a correct 
model  of  that  phenonenon.  The  model  will  exhibit  characteristics 
not  present  in  the  phenonenon  and,  conversely,  there  will  be  fea- 
tures of  the  natural  system  that  will  not  be  reflected  by  the 
model.  The  major  scientific  problem  and  indeed  the  fundamental 
problem  of  mathematical  modelling  is  to  detemine  the  Laws  of 
Nature.  To  determine  these  Laws  of  Nature,  we  have  to  ertploy 
approximate  laws,  the  Laws  of  Man. 

Laws  of  Man.  Man  has  developed  "good"  approximations  to  the 
physical  la'*)s  of  Nature  (Newton's  Laws  of  Motion,  etc.).  However, 
we  have  not  been  so  successful  in  most  areas  of  the  biological  and 
social  sciences  prin^rily  due  to  the  coiplexity  of  the  problems. 

I suspect  that  military  science  can  be  added  to  this  list  of  dis- 
ciplines which,  for  the  most  part,  have  not  had  their  Newton  as 
yet.  To  illustrate  this  point,  in  present  day  plankton  models, 
the  model  farmulaticxis  of  the  biological  processes  are  quite  ele- 
mentary as  ccnpared  with  the  more  sophisticated  physical  processes 
formulations.  Much  aiphasis  needs  to  be  placed  upon  determination 
of  the  fundamental  governing  laws.  The  realization  of  the  funda- 
mental laws  can  come  only  from  basic  science. 

Matharatical  Models:  Simulation  vs.  Propensicn.  The  goal  or 
objective  of  a project  often  determines  the  required  mathematical 
approach.  If  the  goal  necessitates  an  extremely  a<ocurate  predic- 
tive capability,  then  this  modelling  af^roach  will  be  called  a 
simulati(on.  A simulation  should  incorporate  as  much  detail  as 
possible  into  the  mathanatical  model. 

A cdtplanentary  approach  to  simulation  in  mathematical  model- 
ling will  be  called  propensicn.  If  the  project  goal  is  the  deter- 
mination and  understanding  of  the  natural  tendencies,  governing 
characteristics,  or  rudimentary  developments  of  the  system  being 
modelled,  then  only  "essential"  detail  need  be  included  in  the 
model.  It  is,  of  cxiurse,  a major  scientific  task  to  ascertain 
vhat  data,  proxoesses,  and  effec:ts  are  essential. 
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This  classificaticn  of  ircdels  into  the  categories  of  propen- 
sion and  siitEolatiOTi  is  to  seme  extent  arbitrary.  The  anount  of 
detail  in  simulations  can  vary  greatly  as  can  the  degree  of  under- 
standing required  of  propensions.  However,  I have  found  the 
classification  is  useful  if  for  no  other  reason  than  to  force  the 
modeller  to  ccaisider  his  objectives  carefully  before  plimging 
headfirst  into  the  maze  of  analysis. 

Table  1 contains  a cerparative  list  of  seme  aspects  of  for- 
mulation and  analyzation  of  mathematical  models  and  is  presented 
to  indicate  some  differentiations  between  the  two  modelling 
approaches. 

TABI£  1 

A COMPARISCN  OF  ASPECTS  OF  PROPENSION  AND  SMJLATICN 

I.  Prepension  II.  Simulation 

1.  Macroscepio  1.  Microscopic 

2.  Qualitative  2.  Quantitative 

3.  Understanding  3.  Predicting 

4 . Theoretical  4 . Practical 

5.  Basic  5.  applied 

Basic  and  applied  research  have  often  been  regarded  as  dis- 
tinct entities  not  only  by  our  educational  systan  and  sociological 
structures  but  by  our  research  funding  agencies  as  well.  This 
effects  a lack  of  interaction  viiich  has  diminished  our  capacity  to 
develop  theory  in  close  collaboration  with  experiment  and  observa- 
tion. Items  1,  2 and  3 in  Table  1 more  directly  address  the  issue 
of  the  two  alternative  approaches  to  modelling  than  do  itatis  4 and 
5.  The  propensicn  approach  seeks  to  detemine  the  govemijig 
charao:teristics  of  a phenomenon  and  to  understand  the  natural  ten- 
dencies and  macrosoxpic  ideas  involved.  The  tools  of  this  approach 
tend  to  be  qualitative  ones.  Mathematical  formulations  can  be 
sinpler  than  with  simulations.  A simulation  goal  is  to  represent 
a phenomenon  sufficiently  acxnrately  so  that  future  behavior  oan 
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can  be  predicted.  This  goal  requires  utilizaticn  of  each  micro- 
scopic parcel  of  relevant  information.  Simulations  usually  are 
odiplex;  hence,  the  tools  are  often  quantitative  ones.  Use  of  a 
computer  in  model  solution  does  not  by  itself  make  tte  approach 
a simulation  one. 

The  main  advantage  of  a simulation  is  that  a high  degree  of 
accuracy  is  obtained  but  only  for  the  particular  problem  for  which 
it  is  designed.  Generalizations  of  simulations  are  difficult  since 
much  information  is  specific  to  the  situation.  On  the  otter  hand, 
propension  consequences  are  general  conclusions  about  a system 
v*iich  may  extend  to  general  settings  more  readily.  A simulation 
of  a battlefield  situation  must  be  very  detailed  with  personal 
and  general  field  specifics,  such  as  tcpography  and  weather, 
included.  Such  a simulation  would  probably  not  be  applicable  to 

another  battlefield  situation  without  extensive  or  ccnplete  revi-  i 

sion.  I 

3.0  Cono^oAton.  Military  science  is,  in  my  opinion,  grotped  with  | 

many  other  sciences,  at  the  developnent  stage  \^ere  it  is  still  < 

better  to  trust  a field  practioner  than  an  area  theoretician.  As 
such  prcpension  approaches  could  well  be  the  proper  direction  for 
present  modelling  investigations. 

To  illustrate  the  type  of  question  vtiich  can  be  addressed 
from  a prcpension  prospective,  consider  the  following  simplistic 
combat  model.  Letting  N^,  i = 1,  2,  denote  the  strength  of  the 

ith  force,  then  from  Montroll  [1]  we  suppose  that 

^ = div  grad  + B3^Nj^[grad  U^]  - aj^N2  - + P]^(t,  r) 

3N2 

•^  = div  D2  grad  N2  + 62N2[grad  U2]  - oi2N^  - ' 

viherein  D^,  6^,  u^,  are  parameters.  Military  strategy  is 

concerned  with  appropriate  choices  of  the  advective  conpcnents 
6^  grad  and  the  reinforcement  functions  P^.  Qualitative 

questions  such  as:  When  do  the  physical  processes  dominate  the 
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interaction  effects?  When  reinforcements  are  concentrated  in  a 
region,  vrfiat  effect  does  this  have  on  exposing  force  strength? 
Should  be  considered  fron  a propension  viewpoint.  With  our  pre- 
sent degree  of  understanding,  it  is  perhaps  this  general  type  of 
information  that  a field  cemander  should  have  at  his  disposal. 

r?EFERENCE 

[1]  Elliott  M.  Montroll  (1968),  Lectures  on  rtonlinear  Rate 

Equaticyis,  Especially  those  with  Quadratic  Nonlinearities, 
lectures  in  Theoretical  Physics,  A.  O.  Beurut  and  W.  E. 
Brittin  (Ed.),  Gordon  and  Breach,  New  Yor>t,  531-573. 
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SCIENCE  APPLICATION  IN  C^ 

by  GEORGE  E.  KNAUSENBERGER 
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1.0  C’mation  a Vatabcue.  The  dominant  role  of  electronics  in 

C^  is  unquestioned.  Accordingly  the  application  of  resources  and 
talent  in  this  area  premises  that  the  latest  advances  in  electronic 
science  and  technology  are  at  the  disposition  of  tie  users. 

What  is,  however,  not  clear  is  vtiether  these  applications  are 
optimal  and  how  the  needs  in  C^  can  and  should  guide  the  develop- 
ment of  the  electronics  technology.  Obviously  an  integration  of 
insights  is  necessary,  the  electronics  engineer  needs  to  study  C^ 
requiranents  and  the  tactician  has  to  have  knowledge  of  elect- 
ronics capabilities  and  premises. 

) 

The  problems  posed  in  this  context  are  extremely  corplex  j 

and,  in  it^  opinion,  present  understanding  of  tie  processes  and  ] 

needs  is  not  sufficient  to  fully  and  systematically  apply  scienti-  j 

fic  modeling  and  optimization  techniques  in  the  design  of  j 

architectures  and  networks.  j 

For  the  relatively  simple  case  of  the  design  of  telephone  | 

netvrorks  the  microstatistics  have  been  observed  and  macro-behavior  j 

been  determined;  queueing  models  are  based  on  measured  user  statis-  I 

tics.  For  a military  network  these  statistics  are  different  fron 
those  of  the  civilian  net.  For  the  military  situation  there  is 
also  a strong  interaction  between  the  information  flow  and  the 
"action  flow",  information  flow  statistics  differ  and  depend  on 
typje  and  state  of  "battle".  Related  studies  had  been  made  already 
in  the  1950' s by  the  firm  Haller,  Raymond  and  Brown  for  the  U.S. 

Army  in  connection  with  the  observaticn  of  maneuvers.  Also  the 
Maore  School  of  the  University  of  Pennsylvania  had  been  involved. 

These  studies  already  danonstrated  the  absolute  necessity  for 
corprehensive  observations  of  real  field  situations  and  showed,  the 
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ccrplexity  of  the  measuranent  and  evaluaticai  tasks  which  arise 
from  the  variety  and  elusiveness  of  the  cause  and  effect  relations. 
However  great  the  difficulties  are  in  the  description  of  the  logi- 
cal processes,  the  effort  must  be  made,  in  order  to  produce  reason- 
ably efficient  inforinaticn  networks  and  proper  definition  of  the 
information-acticn  and  acticm- information  transducers  for  various 
alternatives  of  acticsi  flews  and  in  order  to  possibly  predict 
these  acticxi  flews. 

While  the  services  have  new  studied  the  problems,  found 
workable  solutions,  established  data  bases  and  created  specific 
organizations,  more  involvement  of  electronic  and  mathematical 

scientists  in  the  full  reality  of  the  problems  could  probably 
still  be  profitable.  This  involvement  should  concentrate  first  of 
all  on  observation,  on  measurement  of  events  and  the  clarification 
of  processes.  While  the  inportance  of  coiputers,  real  time  signal 
processing,  jam  resistant  data  links  or  real  time  targeting,  is 
well  recognized,  the  systems  aspects  of  sorting,  distribution, 
reaction,  interaction,  in  short  the  properties  of  information  and 
action  flew  and  the  transduction  between  them,  ranain  subjects  of 
curiosity. 

It  seems  therefore  necessary  to  relax  into  a time  of  learn- 
ing. Observation  and  measuranent  should  be  prime,  and  be  ccnplete 
as  possible,  before  conclu.'’iais  bout  tools  like  models  or 
response-and  transfer  functions  can  be  attenpted.  Such  learning 
must  be  broadbased  and  long  term  to  be  thorough. 

As  long  as  the  scientist  with  integrated  insight  in  elecd:- 
ronics,  mathanatics  and  in  tactical  and  strategrc  operational 
sciences  and  practices  does  not  exist,  proper  teams  should  be 
formed  which  engage  in  the  study  of  maneuvers,  actual,  simulated 
or  conceived.  Military  maneuvers  should  be  used  e.g.  to  instru- 
ment for  data  collection,  in  order  to  provide  a data  base  for 
later  evolution  of  optimal  netwarks.  Only  after  broad  event 
and  data  study,  the  tools  of  itodem  mathematical  theory  and  of 


electronic  technology  can  be  applied  with  maximum  benefit. 

2.0  Cneation  oij  an  O^ganizatLoiiat  Ba6e.  There  is  in  my  opinion  a 
further  need,  an  organizational  one.  Historically  the  Chief  of 
Staff  for  military  operations  played  the  dominant  role  for  all 
planning,  also  of  the  technology  base.  Developments  have  however 
demonstrated  the  iirportance  and  need  for  a Chief  of  Staff  for 
Technology,  viio  initiates  application  and  generation  of  relevant 
veapons  and  information  systans.  Today,  it  seems,  organization 
considerations  are  in  order  concerning  the  interaction  between 
these  staffs,  because  proper  interaction  will  save  resources  and 
time;  besides,  the  trade  off  between  strategy  and  technology  needs 
special  people  wSiich  can  play  a role  in  both  the  operation  and  in 
the  design  of  systems,  and  which  have  to  be  trained.  Organization- 
si  initiatives  in  this  directim  are  recomnended. 


DISCUSSION 


Otto  Wech:  Are  you  ajddressing  directly  to  the  Ccrmander  as 
operator  or  are  you  envisioning  that  the  Cotmander  interacts  with 
the  system  by  his  staff? 

Denicof f : Either  way.  Frcm  Vvhat  vie  know  of  decision  makers  of 
that  level,  they  tend  to  operate  differently.  They  tend  to  use 
their  staff  differently.  Some  of  them  make  extensive  use  of 
specialists  and  sate  of  than  like  to  get  into  details  themselves. 

Let  me  make  one  content  here,  again  I think  we  are  trying  to 
build  in  maximum  flexibility.  I very  often  here  dogmatic  state- 
ments in  your  direction.  Namely  the  dogmatisn  says  the  Cotmander 
will  never  sit  dcwn  and  be  terminal  - utter  nonsense.  I have 
seen  flag  officers  working  at  terminals  and  even  get  excited  about 
that  type  of  interaction.  I think  ther  will  turn  out  to  be  as 
much  variance  as  there  are  individuals.  Some  senior  officers 
will  always  want  to  rely  on  staff  manbers.  Others  will  want  to 
interact  on  their  own.  One  premise  I have  is  very  time  you  have 
to  use  an  intermediary  - another  person  - there  is  sate  restric- 
tion, sate  inhibition.  If  we  are  going  to  have  feed-back,  and 
that  if  feed-back  has  to  go  through  a second  and  third  generation 
until  it  gets  to  its  Cotmander,  a hell  of  a lot  is  lost.  So  there 
may  be  a real  gain  in  sate  instances  of  having  direct  interaction 
between  various  people  and  the  data  base.  At  least  we  want  to 
provide  that  capability  that  can  be  used  or  ignored. 

Wech:  At  what  level  of  steps  do  you  determine  the  ability  of  the 
systan  to  self  adjust?  Do  you  have  control  over  that?  Or  is  it 
a hardware  or  software  given  feature  that  you  just  take? 

Denicof f : I would  say  vre  have  two  interests.  One  is  to  look  at 
a particular  configuraticn  as  a constraint  on  the  world.  Namely 
what  is  the  best  that  can  be  done  given  that  constraint?  The 
constraint  might  be  a hardware  of  soft  constraint  in  the  form  of 
a system  that  has  been  posed.  We  must  ask  again,  what  constra- 
ints have  been  irtposed  by  that  system?  How  can  those  constraints 

357 


be  alleviated  given  the  restriction  of  that  systan?  That's  one 
goal.  The  other,  I think,  is  a more  research  oriented  goal,  to 
end  up  with  the  specifications  for  the  kind  of  hardware  and  soft- 
ware that  has  to  be  developed  to  make  all  these  desirable  cap- 
abilities possible.  So  one  is  to  live  with  those  real  world 
constraints.  The  other  is  to  write  a specification  to  alleviate 
those  constraints.  You  have  both  objectives. 

Question:  It  seans  that  this  process  has  a tremendous  appetite 
for  numbers  and  underlying  distribution.  Will  you  say  scmething 
about  hew  you  are  going  to  obtain  this? 

Kelly:  Well,  actually  I would  argue  that  it  doesn't  have  too  big 
an  appetite  for  numbers.  The  number  of  judgments  required  for 
the  nodel  I just  described,  I would  think,  would  take  an  exper- 
ienced intelligence  officer  ahead  of  time  scmething  on  the  average 
of  two  to  three  hours  and  certainly  no  more  than  that.  I might 
add  that  recently  I had  an  opportunity  to  woric  on  the  problan  that 
evolved.  We  involved  a variant  on  this  model  and  we  were  able 
f-o  net  the  necessary  input  in  both  the  stage  two  and  stage  three 
in  about  two  hours.  That  says  nothing  about  the  validity  of  the 
niinbers.  I am  sure  you  will  grant  me  that.  I realize  that  lots 
of  peopL  recover  in  a shorter  period  of  time.  I tend  to  think 
that,  ba&d  on  the  consistency  checks  we  did  and  the  fact  that 
the  model  seemed  to  give  pretty  good  results.  It's  inportant  to 
note  that  the  message  doesn't  reside  in  the  numbers.  They  are 
all  very  fuzzy  numbers  and  really  what  we  are  trying  to  do  is 
find  cut  if  the  decision  rules  that  are  reasonably  invarient  can 
be  identified. 

Sacerdoti : I have  a slightly  related  question  here;  hew  sensi- 
tive is  the  consistencies  of  those  numbers  and  underlying  models 
to  be  used  because  we  will  be  dealing  with  different  pieces  of 
the  problan  at  a time. 

Kelly:  It  is  rather  hard  to  answer  that  without  getting  very 
specific.  Seme  models  are  not  very  sensitive  at  all  and  in  others 
it  makes  a tremendcus  difference.  For  exanple,  this  little  dia- 
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gram  I put  153  there.  You  could  vary  the  weight  designed  to  the 
different  criteria  all  over  the  place.  In  fact,  you  could  drop 
any  of  the  four  value  criteria  that  we  need  as  applicable.  It 
wouldn't  make  any  difference.  In  other  models,  of  course,  that 
is  certainly  not  the  case.  I am  sure  there  must  be  some  underlying 
generalities,  rules  of  thumb,  vre  could  use  to  make  judgments  of 
that  sort,  but  we  have  not  been  able  to  identify  many  of  them  at 
this  time. 

Bracken:  In  the  model  that  you  constructed,  as  I understand,  it 
there  are  various  actions  available  to  Blue  certain  probabilities 
of  just  taking  those  actions  or  perhaps  adopting  a mixed  strategy. 
Kelly:  The  options  that  are  available  to  than  are  simple.  Those 
are  available  to  than  - you  can't  rightly  say  as  to  what  likeli- 
hood he  will  choose  one.  The  intent  is  given  possibilities  in 
respect  to  Red's  actions  as  to  which  option  we  should  in  fact 
choose.  Should  Blue  shoot  or  not  shoot,  given  the  uncertainty 
that  the  incoming  aircraft  is  an  enemy  plane. 

Bracken:  Well,  let  me  answer  the  question  in  another  way.  How 
would  you  generalize  this  model  if  you  were  looking  at  things  in 
a game  theoretical  context,  v^ere  Blue  had  available  to  him  sane 
actions  he  might  take  with  certain  possibilities  and  Red  did  the 
same. 

Kelly:  One  way  is  simply  to  say  that  the  likelihood  that  Red  is 
going  to  do  something  vrould  be  conditioned  upon  what  Blue  chooses 
to  do  and  you  siitply  represent  it  in  the  form  of  a conditional 
possibility.  You  run  it  out  until  sufficient  time  elapses  so  that 
carrying  it  beyond  that  point  singly  has  no  effect  on  the  choices 
you  cure  faced  with  inmediately.  The  sinple  little  model  that  I 
described  didn't  have  that  kind  of  conditionality  in  it.  Others 
certainly  do.  For  exairple,  the  choice  of  whether  or  ont  to  use 
certain  tactical  nuclear  options  in  Europe  would  certainly  deter- 
mine to  an  extent  what  the  Warsaw  Pact  might  do.  The  inpact  or 
likelihood  that  the  Warsaw  Pact  would  go  one  way  or  another.  If 
you  sinply  look  at  that  situation,  you  would  work  with  probabil- 

359 


i 


ities  that  are  directly  conditional  on  your  own  choices. 

Bracken;  I think  that  prctebility  approach  here  is  called  for, 
not  game  theory. 

Kelly;  That  is  absolutely  right.  As  a decision  theorist  I would 

approach  it  that  way  not  using  game  theory,  although  one  might  ^ 

well  approach  it  using  game  theory. 

Bracken:  Don't  you  think  there  is  seme  inconsistencies? 

Kelly:  No,  but  I am  certainly  willing  to  be  educated.  I can’t 
think  of  any  inconsistencies  - none  ceres  to  mind. 

Bracken:  Well,  if  it's  a sequence  of  simultaneous  moves,  then  ; 

you  don't  get  an  opportunity  to  obser(?e  while  you  are  moving.  If  j 

it  is  a sequence  of  moves  vdiere  Blue  moves.  Red  troves.  Blue  moves, 
then  you  get  a chance  to  observe,  but  if  they  are  moving  simul- 
taneously. . . 

Kelly:  There  is  a difference  between  vdiat  one  actually  sees 
unfolding  in  the  world  and  how  one  constructs  a decision  diagram 
that  would  help  you  choose  a coarse  of  action  today.  You  can 
certainly  construct  a decision  diagram  today  under  the  assunption 
that  the  moves  will  be  sinultaneous  and  not  sequential.  In  that 
case,  of  course,  the  probability,  at  least  in  the  first  stage 
moves  of  Red,  will  not  be  conditional  upon  vdiat  we  do. 

Bracken:  What  do  you  do  then? 

Andrews:  I guess  you  would  make  an  estimate  of  the  situation 
based  on  the  intelligence  you  have  available.  It  doesn't  sean 
to  be  a very  satisfactory  answer,  but  it  appears  to  be  the  only 
one  availcible. 

J.  Thempson:  If  you  are  saying  to  use  a diagram  such  as  you 
have  indicated  as  an  Educational  Aid,  I think  there  are  useful. 

But  if,  as  I understand,  you  are  actually  proposing  this  to  be  a 
decision  aid  in  real  time,  in  real  world  situation,  I find  it 
absolutely  terrible.’  That  is  a tactic  Oomtander  who  is  going  to 
be  sitting  in  Washington  watching  a stochastic  bug  walking  across 
a triangle  which  has  probabilities  which  are  very  fuzzy  ar»3 
'Utilities  which  are  very  fuzzy.  It  seems  to  me  very  dangerous. 
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Particularly  since  the  CIA  syndrono  may  tell  him  that  as  soon  as 
the  bug  crosses  the  attack  boundary,  we  should  attack. 

Kelly:  I don't  think  it  doesn't  actually  say  that. 

J.  Thciipson:  Well,  what  does  it  say?  It  says  the  machine  is 
telling  you  to  attack  and  you  do  \4iat  you  please. 

Kelly:  Well,  that  is  not  what  it  says.  It  says,  based  upon  the 
inputs  and  under  these  conditicais,  you  should,  in  fact,  prepare 
to  attack  and  execute.  New,  just  as  the  trigger  that  Bob  was 
talking  about  earlier  in  respect  to  Daisy  is  designed  to  evoke 
sane  kind  of  response  frem  the  decision  maker,  to  that  extent, 
that  is  doing  exactly  the  same  thing.  It  is  designed  as  an 
aid  based  upon  the  camander's  perception  of  the  situation  with 
sane  of  the  data  put  in  ahead  of  time  and  sane  put  in  in  real 
time. 

J.  Thanpson:  Not  basically  though,  I mean  it  is  the  decision 
part  and  therefore  it  is  a bit  more  than  just  useful  information. 
I think  your  exaiiple  about  what  things  have  been  tried  in  busi- 
ness wDrks  pretty  well.  It  points  out  a key  difference  between 
a military  situation  and  a business  situation.  That  is,  nations 
can't  take  the  bankrupt  law.  If  you  try  something  based  on  such 
and  such  data  and  such  and  such  a utility  function  in  business 
and  you  are  wrong,  you  just  take  the  bankrupt  law  and  wait  •.  jc 
months  and  you  start  over  again.  Nations  can't  do  that. 

Kelly:  Well,  let  me  answer  that  in  the  following  way.  You  said 
this  terrified  you,  but  there  is  sonething  that  ought  to  terrify 
you  more  and  that's  people  trying  to  do  all  this  in  the  lead  of 
a single  individual. 

J.  Thanpson:  I am  sorry,  but  I am  willing  to  trust  this  bo  an 
experienced  Coitnander.  In  certain  situations  he  gets  his  infor- 
mation fron  the  Secretary  of  State,  maybe  even  the  President. 

But  you  are  really  talking  about  a situation  wtere  Blue  was  the 
United  States.  This  is  an  honest- to-God  situation.  You  watch 
it  in  simulation.  If  I understand  it  correctly,  the  way  you  are 
talking  about  it  in  such  a situaticn  \4iere  Orange  is  the  satel- 
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lite  state  of  Red  and  Blue  is  the  U.S.  Here  is  the  Cotmander 
watching  the  little  bug  walking  around  instead  of  getting  on  the 
comnunications  systan  and  getting  all  the  information  he  Ccin 
fron  his  subordinates  and  also  fron  his  superiors.  I think  that 
terrifies  me  a good  deal  more  than  anyting  that  is  in  the  head 
of  one  individual. 

Kelly:  Well,  I think,  of  course,  that  is  the  coiplexity  of  some 
of  these  things  are  going  to  be  evaluating  during  the  next 

I year.  I think  that  what  I have  presented  is  a tool.  To  the 

.i 

j extent  that  it  is  used  correctly,  I believe  it  can  be  of  use,  and 

i can  be  quite  valuable.  To  the  extent  that  you  have  saneone  who 

says,  "Gosh,  the  bug  crossed  the  threshold  and  therefore  I am 
I going  to  push  the  button."  That's  like  saying  a monkey  wrench 

is  no  good  because  saneone  else  can  go  out  and  hit  someone  on  the 
head  with  it.  I think  it  is  most  inportant  to  keep  the  context 
straight.  What  they  are  talking  about  is  a sophisticated  aid. 

A clever  version  of  a Catinander's  oracle,  so  to  speak.  Nothing 
really  different  except  the  inplementation  from  the  underlying 
framework  from  the  systan  used  in  the  British  Navy  and  ettploys 
today.  I share  your  concern  because  one  of  the  things  that 
bothers  me  is  that  people  won't  use  this  correctly.  I do  know 
enough  about  unaided  intuition  to  knew  that  there  are  sane  good 
decision  makers  and  sane  bad  decision  makers.  I think  that  for 
those  that  aren't  as  facile  as  others  sonething  like  this  is 
probably  a better  alternative  used  in  an  aid  than  letting  a chap 
muddle  through  on  his  cwn. 

Welch:  Let  me  understand  vhat  you  are  saying  here.  It  seems  to 
me  that  one  way  to  describe  what  you  have  there  is  a way  systema- 
tically to  mix  current  data  with  another  set  of  data  with  a set 
of  value  judgments,  of  a set  of  logic  connections,  which  you 
though  ip>  prior  to  the  event.  For  exanple,  the  logic  tree  and 
the  different  kinds  of  concern  and  the  weight  you  put  on  those 
concerns.  That,  to  me,  seems  to  be  considered  data  as  well  as 
anyting  else  ineltding  the  mission  you  are  given  among  other 
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things.  It  does  seem  to  nve  one  sinple  way  to  describe  what  you 
chose  to  talk  about  is  at  least  a systematic  way  of  mixing  current 
data  on  situations  and  post  data. 

Kelly;  That  is  absolutely  correct  airi  it  might  be  thought  of  in 
another  sense.  As  a way  to  inbergrate  both  the  J2  and  the  J3 
while  preserving  their  integrity. 

Bonder:  It  is  a bit  more  than  that  Jeff.  It  does  suggest  that 
if  one  were  "rational"  one  wrould  act  per  the  action  space  parti- 
tioning. 

Kelly:  Right,  I am  assiming  that  you  got  all  the  risk  and  every- 
thing else  in  there  that  I didn't  even  talk  about. 

Bonder:  There  is  an  action  space  there  that  is  divided  and  it  is 
divided  based  on  beliefs  and  certain  assuttptions  made  / a great 
mathematician  a few  years  ago.  The  tree  folding  back  is  based 
on  seme  logic  that  is  seme  set  of  assunptions  about  how  one 
folds  back  trees.  One  folds  back  trees  that  way  if  you  believe 
the  "assumption"  on  hew  to  fold  back  trees.  I am  not  saying 
they  are  right  or  wrong.  I am  just  saying  there  are  explicit 
rules  on  how  to  fold  back  trees.  All  I am  saying  is  the  Cerman- 
der  should  knew  he  has  certain  transitivity  kinds  of  beliefs 
about  the  world  before  he  should  say,  "I  see  that  kind  of  space. 
I'll  that  way".  You  all  know  vrtiat  I am  talking  about  I think, 
in  so  far  as  what  axioms  I am  refering  to.  If  he  believes  in  it, 
fine.  If  he  doesn't,  he  ought  to  think  about  it  a little  strong- 
er before  he  says  something.  It  is  more  than  just  a data  basis. 

It  is  a decision  making  logic  that  is  considered  to  be  rational 
if  you  believe  in  a certain  set  of  axioms.  All  I am  saying  is  a 
Coimander  should  know  what  they  are  if  he  washes  to  follow  that 
kind  of  prescription. 

George  Pugh;  I think  the  thing  that  bothers  ne  most  about  the 
decision  aid  is  the  underlying  assuirption  that  your  conditional 
probabilities  are  constant.  I understand  that  the  user  puts  the 
conditional  prcAaabilities  in  on  the  assumption  of  various 
scenarios  that  he  thinks  of  as  possible  alternative  enemy  courses 
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of  action.  If  a different  set  of  scenarios  begin  to  unfold,  lie 
might  have  wished  he  had  put  in  different  conditional  probabil- 
ities. question  is:  Do  you  have  in  mind  sane  way  of  testing 
the  probably  constancies  of  the  conditional  probabilities  in 
sane  sort  of  realistic  situations? 

Kelly:  The  intent,  really,  when  we  began  this  whole  set  of  prob- 
abilities was  to  present  the  modified  J2  as  a situational  on 
holding.  So  that  is  the  negative  in  vAiich  we  are  sr^jposing  to 
acconodate.  To  answer  your  question;  what  we  are  doing  now  is 
looking  at  a variety  of  scenarios  using  the  sane  franework  and 
simply  trying  to  get  a feel  for  the  extent  in  vifeLch  these  prob- 
abilities change,  and  viiat  characteristic  of  scenario  is 
responsible  for  the  change.  And  this  leads  to  all  sorts  of 
speculation  on  updating  and  interpolation  methods  one  might  go 
to  later,  but  that’s  quite  far  in  the  future. 
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INTRODUCTION  TO  GENERAL  SYSTEMS  PANEL 
by  LT,  COL.  R.A,  GEESEY 


I am  not  a scheduled  speaker,  but  I would  like  to 
take  a minute  to  describe  an  anecdote  about  our  pre- 
paration for  this  workshop.  Before  working  in  Air 
Force  Studies  and  Analysis,  I was  a researcher  in 
systems  theory  and  systems  analysis  — I have  some 
alliance  with  this  particular  panel  of  the  workshop. 

My  systems  background  led  me  to  try  thinking  in  a 
systems  way  about  the  general  problem  of  decision 
information  and  tactical  command  and  control  — that 
is,  I tried  to  draw  up  a network  structure  for  the 
problem;  and  I think  yesterday's  demonstration  made 
clear  enough  where  that  approach  leads  — Colonel 
Thompson's  "worm  chart"  showed  the  complexity  of  the 
network  topology. 

It  was  about  a year  ago  that  I had  a conversa- 
tion with  Lieutenant  Colonel  Walt  Rabe  of  the  Air 
Force  Office  of  Scientific  Research  about  ways  that 
Studies  and  Analysis  and  his  office  could  get  together 
various  research  disciplines  for  command  and  control 
interests.  We  felt  that  mathematics,  statistics, 
and  the  physical  sciences  — as  well  as  behavioral 
sciences,  philosophy  and  many  of  the  other  disci- 
plines that  are  in  fact  represented  here  today  — 
interact  in  useful  ways  for  application  to  the  general 
area  of  decision  information  for  tactical  command 
and  control.  Lieutenant  Colonel  Rabe  and  I roughed 
out  a diagram  of  scientific  disciplines  , the  sub- 
areas  within  them,  and  some  of  the  theories  involved 
in  research  interests.  Our  diagramming  of  intercon- 
necting relations  between  disciplines  and  theories 
quickly  began  to  resemble  the  complexity  of  Colonel 
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Thompson's  "worm  chart." 

I think  we  learned  that  there  is  a duality 
between  the  problems  and  their  solution  I There  are 
obviously  communication  problems  in  the  flow  of 
information  within  combat  information  systems  and  the 
command  and  control  processes.  The  duality  is  the 
communication  among  disciplines  and  technical  areas  — 
the  flow  of  ideas  and  data  that  we  are  attempting  to 
enrich  by  this  workshop. 

We  were  pleased  to  see  the  excellent  exchanges 
in  the  earlier  sessions  and  expect  that  this  General 
Systems  Panel  will  be  able  to  further  broaden  our 
communication  about  relevant  research.  The  remarks 
to  be  made  by  our  participants  for  this  panel  can 
lead  discussions  into  several  profitable  areas  — 
some  diverse  from  exactly  what  is  going  on  within 
systems  theory  itself. 
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'TIE  LESSCfflS  LEARNID  IN  TRANSLATING  RIQUIREMENTS 
INTO  CAPABILITIES:  TIE  WWMCCS  ARCHITBCTORE" 


by  KENNETH  A.  HOMDN 

hit&'incitionat  SuiineJ>6  Mackin&i  Co'ipoAdtion 


This  paper  sunmarizes  frcm  an  informatics  flow  perspective 
the  lessons  learned  in  translatinq  requirarents  into  capabilities 
(technological  solutions  vdiich  satisfy  requirarents  to  varying 
degrees)  for  the  world  wide  military  ccmand  and  control  system 
(WWMCCS)  architecture  project.  The  purpose  of  the  project  was  to 
develop  WWMCCS  architectural  alternatives  for  the  mid  19C0's  fron 
which  the  VWCCS  council,  cotprised  of: 

Deputy  Secretary  of  Defense 
Chiarman  of  the  Joint  Chiefs  of  Staff 
Assistant  Secretary  of  Defense  for  Intelligence 
Director  of  Teleccmiunications , Catitand  and  Control 
WWMCCS  Architect 

could  select  a single  architecture  and  to  develcp  a transition 
plan  for  the  inplementation  of  the  architecture.  The  architec- 
tural plan  was  the  final  result  of  approximately  two  years  of 
analysis  of  WliJMCCS  requirements,  baseline  programs,  and  technology 
available  for  the  next  decade.  That  analysis  enphasized  the  pri- 
mary mission  of  WWMCCS  as  defined  in  DCO  directive  5100.30,  namely, 
support  of  the  national  caimand  authorities  (NCA) . To  carry  out 
that  mission,  the  direct  mission  support  activities  of  the  unified 
and  specific  carmands  and  their  conponent  ccrmands,  the  defense 
agencies,  and  the  military  services  were  included. 

The  requiratents  v«re  based  on  an  analysis  of  representative 
crisis  and  conflict  situations  that  might  involve  U.S.  military 
resources  during  the  next  decade.  For  each  situation,  NCA 
response  cpticxis  were  postulated.  The  response  option  analysis 
vas  then  used  as  a basis  for  documenting  the  functional  and 
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inforrotional  requiraients,  txDgether  with  their  associated  perfor- 
nance  parameters,  which  IWiMCCS  must  si,?5port. 

A concurrent  analysis  of  the  WWMXS  baseline  (current  pro- 
grams) was  conducted  to  determine  whether  the  baseline  capabilities 
met  the  documented  requiranents  and  to  identify  capability  short- 
falls. Each  capability  shortfall  - for  exanple,  the  lack  of  con- 
nectivity or  the  inability  to  counter  the  expected  threat  (physical, 
electronic,  and  nuclear  effects)  - was  analyzed  against  available 
technology.  Candidate  feasible  technical  solutions  were  then 
developed  and  costed.  The  resulting  capability  improvements  were 
reviewed  with  the  MMXS  ccnmunity  and  with  the  WWMCCS  council. 

The  WMCCS  council  guided  the  architect  in  the  selection  of  a 
set  of  high-priority  capability  inprovements  which  they  desired  to 
be  inplemented  (i.e. , achieve  full  operational  capability,  or  POC) 
by  the  mid  1980 's.  These  inprovements,  when  incorporated  with  the 
baseline,  comprise  the  selected  architecture.  Also  included  with 
the  selected  architecture  are  several  major  R&D  programs;  these 
programs  are  required  to  examine  the  technology,  operational  util- 
ity, and  costs  of  several  significant  capability  inporvements  which 
could  not  be  definitively  evaluated,  scheduled,  and  costed  prior 
to  such  additional  RiD. 

The  capability  improvements  which  would  be  incorporated  in 
the  architecture,  if  tlie  MD  programs  are  successful,  together 
with  capability  inprovanents  which  t)ie  council  decided  were  of 
lower  priority,  were  identified  as  the  long-range  architecture. 

The  capabilities  in  this  architectural  segment  are  planned  to 
achieve  POC  after  1985. 

The  two  tine-phased  segments  - the  selected  architecture, 
which  incorporates  the  baseline,  and  the  long-range  architecture - 
corprise  the  WMCCS  architecture.  The  architecture  is  svpple- 
mented  by  a "corporate  memory, " which  records  all  of  the  tentative 
decisions  made  by  the  WWMCCS  council  during  their  review  and  which 
led  to  the  architectural  plan. 
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The  first  major  step  in  a C architecture  developnent  process  is 
to  define  the  operational  envirorment  vdiich  includes: 

o The  defense  policy  or  policies  under  which  operations  will 
be  conducted.  A corollary  of  this  factor  is  the  national 
level  objectives  to  \4uch  these  policies  are  related. 

o The  forces  which  are  planned  to  be  available  for  the  con- 
duct of  operations,  including  the  weaponry  vdiich  will  be 
available  for  enployment  by  those  forces.  The  current 
plans  for  modification  and  inprovatent  of  those  forces 
must  be  understood. 

o The  potential  enemies  against  vrtian  the  forces  are  to  be 
aiployed,  together  with  estimates  of  their  force  structure 
and  weaponry. 

o The  naticffial  decision  process  within  viMch  must  func- 
tion. 

o The  specific  set  of  nodes  and  interfaces  vrtiich  must 
support.  These  nodes  and  interfaces  r^resent  a defini- 
tion of  the  organizational  boundaries  of  system.  Major 
interfaces  include  the  intelligence  systan,  political  and 
diplomatic  systans,  administratiai  and  logistics  systems, 
envirormental  systans,  and  tactical  systans.  The  input 
needs  must  be  specified  as  interface  requirements  of  the 
Vcurious  architectures  and  a determination  of  the  inpact  of 
those  interface  requirements  on  the  interfacing  systans. 

o Representative  situations  and  opticxis  vAvLch  translate  the 
broad  operaticsial  environmental  factors  into  a useable 
form  for  requirements  derivaticai  and  assignment  of  per- 
formance parameters. 

We  gained  tremendous  insights  for  developing  the  architecture  fron 
the  analysis  performed  to  determine  the  inplication  of  each  factor 
on  requirements.  Each  was  examined  specifically  to  identify 
potential  requirements  and  rationale  for  subsequent  perfomance 
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requirenents. 

The  requirements  for  a WWMX'S  architecture  in  a crisis 
environment  can  be  defined  in  two  categories:  information  and 
capabilities  or  functional  requirements.  Information  requirements 
define  the  flow,  content  and  characteristics  of  informaticxi  re- 
quired for  the  performance  of  effective  crisis  management.  Capa- 
bility requirements  define  interfaces,  procedures,  catmunications 
and  autcmated  support  capabilities  that  are  required  to  facilitate 
the  acquisition  and  exchange  of  information  and  to  sup^xDrt  the 
decision-making  process. 

Capabilities  or  functional  requirements  answer  the  question, 
"What  must  the  C^  system  be  able  to  do?"  The  requirements  are 
driven  by  policy  and  planning  guidance,  factors  of  operational 
environment,  and  representative  situations  and  options  which  par- 
tially formulate  the  operational  environment. 

In  itany  respects  the  two  categories  of  requirements  are 
closely  related  with  distinct  similarities  between  individual 
requirement  characteristics  of  the  two  categories.  These  simi- 
larities are  indicative  of  the  fact  that  the  success  of  the  WWMCCS 
is  dependent  upon  the  ability  of  the  architecture  to  integrate  the 
two  categories  of  requirements  into  a cotmon  operational  capability. 
The  mutual  dependency  of  the  requirements  is  illustrated  by  the 
observation  that  the  information  elements  identified  will  not  be 
obtainable  without  the  existence  of  relevant  system  capabilities. 
Similarly,  there  is  no  reason  for  the  existence  of  system  capa- 
bilities if  no  need  for  the  information  elanents  exists.  When 
fully  integrated,  the  two  categories  provide  a coiplete  require- 
ments definition. 

In  the  analysis  of  reqmrements  for  the  WWMCCS  crisis  archi- 
tecture for  the  mid  1980 's,  one  of  the  najor  issues  was  how  to 
ensure  corpleteness.  That  is,  how  could  one  be  sure  that  when  a 
set  of  requirements  had  been  identified,  they  would  be  sufficient 
to  meet  the  needs  of  future  crises?  Tliis  was  solved  for  the  WWCCS 
architecture  in  two  ways.  First,  approximately  200  crisis  situa- 
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tions  involving  the  NCA  over  the  past  several  years  were  examined 
to  determine  characteristics  of  crisis  information  requirements. 
Secondly,  a highly  structured  analysis  methodology  was  applied  to 
a set  of  postulated  crises  which  are  representative  of  those  like- 
ly to  occur  in  the  mid  1980 's  to  quantify  the  full  set  of  infor- 
imtion  requirements. 

An  independent  analysis  of  the  mid  1980' s operational  environ- 
ment and  expected  alignments  of  nations  set  the  range  of  values  of 
the  major  factors  involved  in  a C architecture.  These  factors, 
which  were  called  curchitectural  drivers,  are  shown  in  Figure  1.  A 
preliminary  analysis  of  the  two  hundred  crises  revealed  that  they 
collectively  spanned  the  set  of  major  architectural  factors  shown 
in  Figure  1 and  that  they  possessed  operational  characteristics 
that  would  be  catnon  to  future  crises. 

The  structured  analysis  methodology  for  determining  informa- 
tion requiranents  followed  the  general  outline  shown  in  Figure  2. 
For  each  situation/cption,  information  requirements  were  analyzed 
to  determine  those  necessary  to; 

1)  characterize  the  situation 

2)  define  the  possible  response  options 

3)  select  among  the  possible  response  opticms 

4)  inplement  the  chosen  option 

The  arrows  depict  the  direction  of  information  flow  to  support 
these  tasks. 

The  detailed  analysis  of  the  set  of  9 crises  was  performed  by 
four  teams  of  two  individuals  each.  The  e^qaerience  and  qualifi- 
cation of  individuals  assigned  provided  a bro>ad  cross-secticxi  of 
top-level  military  knowledge  and  analytical  expertise. 

After  gaining  an  understanding  of  a situation,  teams  placed 
themselves  in  the  position  of  addressing  the  tasks  associated  with 
each  of  the  eight  functional  areas  with  the  purpose  of  identifying 
the  information  required  for  effective  crisis  managanent.  The 
functional  areas  pertaining  to  crises  are  listed  below: 
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1 . Indications  monitoring 

2.  Potential  enemy  force  ard  resource  status  monitoring 

3.  U.S. /allied  force  and  resource  status  monitoring 

4.  Planning  and  replanning 

5.  Warning  and  assessment 

6.  Selecticn  and  executicji 

7.  Operations  monitoring 

8.  Daitage  assessment  and  control 

These  functional  areas  collectively  span  the  activity  areas  that 
nake  up  each  crisis. 

Identification  of  informatics!  requirements  was  acconplished 
by  each  team  through  the  development  of  key  questicxis  designed  to 
uncover  the  critical  information  requirements  for  each  situation. 

For  each  questicsi  that  was  developed  the  analysts  also 
developed  a set  of  information  characteristics  that  identified 
the  following  factors: 

Information  requests/residence  indicator  — is  the  infonra- 
tion  supplied  as  an  established  procedure,  or  as  the  result 
of  a direct  query  or  request? 

Cdirnunication  links  — Wliat  are  the  sources  and  destinations 
of  the  information? 

Information  currency  — What  is  the  maximum  time  gap  that 
informaticsi  should  reflect  with  respect  to  the  occurrence  or 
condition  being  addressed? 

Informaticffi  dependency  — How  dependent  is  effective  crisis 
management  on  the  availability  of  the  informatics? 

Information  precedence  — How  long  should  the  physical  ccm- 
munication  of  the  information  take,  once  it  is  available  for 
transmission? 

Acqui sition/development  time  — What  is  the  maxinnm  time  that 
should  be  required  to  prepare  the  information  for  transnission 
if  it  is  originated  as  a standard  procedure?  What  is  the  max- 
imim  acquisition  time  available  for  a response  to  a request 
or  query? 
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Mode  of  transfer  — What  iieans  of  transmitting  the  informa- 
tion is  most  meaningful:  e.g.,  data,  charts  and  pictures? 
Security  — What  is  the  highest  security  level  that  must  be 
associated? 

Volume  — How  much  data  in  terms  of  words  must  be  transmitted? 
(Applicable  to  data  mode  only) 

Frequency  — How  often  during  the  crisis  will  this  informa- 
tion transmission  be  required? 

Fornetted/narrative  indicator  — Should  the  information  be 
transmitted  in  a formatted  or  narrative  form? 

These  information  characteristics  are  shown  in  Figure  3 along  with 
the  architectural  solution  areas  (WWCCS  element)  most  concerned  - 
with  performance  capabilities  needed  to  satisfy  the  information 
requirements.  We  learned  that  each  WWMXS  elements  has  to  inter- 
pret the  results  of  situation  analysis  differently  because  each 
was  driven  by  different  factors.  Conmunications  solutions,  for 
example,  were  driven  by  threat:  ADP  was  only  indirectly  driven 
by  threat,  i.e.  through  facilities.  Therefore,  the  information 
requirements  were  supplemented  by  analysis  of  the  operational 
envirorment  vhich  was  documented  as  architectural  guidelines  for 
each  element. 

Examples  of  information  requiranents  based  on  situation 
analysis  are  shown  in  Figures  4,  5 and  6 which  represent  three  of 
the  more  critical  areas.  Figure  4 depicts  the  data  currency  re- 
quiranents.  This  figure  shows,  for  exanple,  that  data  that  is  an 
hour  old  satisfied  70%  of  the  information  requirements  for  the  9 
crisis  situations,  while  data  one  minute  old  meets  100%  of  require- 
ments. T)iis  figure  also  implies  that  there  is  a soluticxi  trade- 
off between  a highly  responsive  reporting  capability  and  data  base 
update. 

Figture  5 depicts  the  data  precedence  requirements.  This 
figure  shews  that  data  transmitted  within  10  minutes  of  being 
available  satisfies  all  precedence  requiranents  for  the  9 situa- 
tions. The  requiranent  for  a rapid  transmission  capability  is 
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FIGURE  3 

V*MXS  INPORMATICN  REQUIREMENT  CHARflCTERISTICS 
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Information  Requiranent  Characteristics  Architectural  Element 
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PRCCEDEKCE:  RAPID  TRANSMISSION 
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obvious  from  this  curve. 


Figure  6 depicts  data  acquisition/development  time  require- 
ments. This  figure  shews  that  95%  of  the  requirements  of  the  9 
situations  are  satisfied  if  data  is  available  for  transmission 
within  5 minutes  of  being  requested,  and  that  data  must  be  avail- 
able iimediately  if  100%  of  the  requirements  are  to  be  satisfied. 

Traceability  frem  functioial  requirements  back  to  individual 
situation  information  requirements  was  maintained  by  nunbering 
each  key  question  and  the  answer  to  each  question.  Thus,  if  a 
performance  capability  is  selected  vdiich  satisfied  80%  of  the  in- 
formation requirements,  it  is  possible  to  clearly  state  the  situ- 
ations in  which  the  remaining  20%  ol  the  infontation  requirements 
occur  and  see  the  effect  of  the  selected  performance  capability. 

It  was  our  experience  that  this  traceability  was  much  more  impor- 
tant for  the  situatiem/options  involving  nuclear  responses  because 
of  the  architecture  cost  drivers.  Since  architectural  costs  did 
not  vary  significantly  for  crisis  situaticn/optiois,  this  trace- 
ability  is  not  needed  for  one  crisis  architecture  over  another. 

While  there  is  some  interdependence  shown  in  the  exanples 
just  described,  the  total  set  of  performance  capability  require- 
nents  was  used  and,  indeed,  provided  sufficient  data  to  develop 
architectural  solutions  for  the  five  C architectural  elanents. 

Performance  parameters  are  unique  to  each  element.  For  exanple,  j 

in  ADP,  the  generic  parameters  are  related  to  the  volume  and 

timeliness  requirements  for  the  categories  of  message  processing, 

file  update  and  maintenance,  coiputation,  query  and  response,  and 

display  activities.  In  contrast,  the  generic  perfomance  para- 

iiEters  required  in  carmunications  related  to  the  major  categories  l 

of  number  and  distributicn  of  secure  voice  facil  cies,  secure 

record  facilities,  secure  voice  conferencing,  facsimile  and 

imagery.  This  lesson  vras  learned  by  initiating  the  development 

of  a pilot  architecture  simultaneously  with  the  definition  of 

requirements.  The  pilot  provided  insight  into  what  requirements 

are  the  most  important  and  in  what  terms  they  are  most  meaningful. 
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The  capabilities  required  to  support  the  crisis  total  infor- 
mation flew  can  be  focused  at  four  generic  nodes  shown  in  Figure 
7 : The  origin  (the  crisis  location) , the  cenrand  center  coordi- 
nating the  crisis  response,  the  decision  maker  responsible  for 
taking  action,  and  the  CINC/force  level  responsible  for  inple- 
menting  the  military  acticxi  at  the  direction  of  the  decison  maker. 

The  capabilities  needed  at  the  origin  are  shown  in  Figure  8. 
They  include  a transportable,  fiand-held  reporting  device  with  the 
capability  of  transmitting  over  a crisis  alert  network.  In  order 
that  the  data  reported  fran  the  origin  will  be  rs^idly  available 
to  the  users,  reporting  procedures  are  required  that  enploy  such 
features  as  standard  message  phrases,  automatic  formatting,  and 
transmitting  only  parameter  values  for  a pre-established  list  of 
critical  information  factors.  All  of  this  data  can  then  be  rapid- 
ly formatted  at  the  receiving  end  and  will  also  be  in  a form 
inmediately  processable  by  coiputers  for  dynamic  handling  and 
data  base  update.  In  order  to  maintain  a current  data  base  on 
involved  assets  in  a crisis,  the  capability  prescribes  reporting 
events  as  required  (as  changes  occur)  by  the  origin  rather  than 
a prescribed  reporting  interval.  To  ensure  an  interaction  capa- 
bility between  the  origin  and  the  caimand  center  an  interrogation 
response  capability  for  the  reporting  device  is  required. 

The  capabilities  needed  at  the  cotmand  center  are  shown  in 
Figure  9.  They  include  an  automated  message  handling  capability 
and  the  ability  to  autcmatically  update  data  bases  with  message 
data  and  perform  correlation  assessments  between  reported  data 
and  data  already  resident  in  oermand  center  data  bases.  Addi- 
tionally, there  should  be  an  on-line  interaction  capability  among 
data  bases  maintained  by  operations,  intelligence,  and  other 
agencies.  The  capability  to  maintain  an  action  log  to  display 
current  status  and  a chronological  history  of  activities  is  also 
required  so  that  anyone  unfamiliar  with  on-going  events  or  rotat- 
ing shift  personnel  can  review  the  entire  log  if  necessary. 
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FIGURE  7 

VMCCS  CRISIS  GENERIC  NODES 

V*MCCS  CAPABILITIES  TO  SUPPORT  CRISIS  TOTAL  INFORMATION  FLOW 
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FIGURE  8 

WWM3CS  CRISIS  ORIGIN  CAPABILITIES 
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V*MXS  CAPABILITIES  TO  SUPPORT  CRISIS  TOTAL  INFORMATION  FLOW 

ORIGIN  - REPORTING  DEVICE  AND  CRISIS  ALBIT  NBm»K 

STANDARD  MESSAGE  PHRASES 

AUTOMATIC  FORMATTING 

PARAMETER  TRANSMISSION  - MESSAGE  CONSTRUCTION  AT 

RECEIVER  END 

REPORTING  FREQUENCY  - AS  REQUIRED 

INTERROGATION  RESPONSE  CAPABILITY 


FIGURE  9 


WWCCS  CRISIS  COWAND  CTNTER  CAPABILinES 

WWiOCS  CAPABILITIES  TO  SUPPORT  CRISIS  TOEAL  INFORMATION  FLOW 

COMAND  CENTER  - AUTCMATED  MESSAGE  HANDLDCA'PDATE  INFORMATION 
CORREIATICN  ASSESSMENT  — (ON-LINE  INTERAC- 
TION DATA  BASE,  INTER,  INTRA-ECHEICN,  OTKER 
AGENCIES) 

o EtEPORTED/RESIDENr 
o OPS/INTEUVOTHER  AGENCY 
0 STATUS  OF  ACTION  LOG 

0 OPTION  DEVELOPMENT/AD  HOC  PIANNING 

0 GROUP  DISPLAY  CONFERENCING 
o ON-LINE  DATA  BASE  INTERACTION 
0 MCOEIS-COST  CONSEQUENCES 


I 

In  order  for  the  staff  at  the  cdtinand  center  to  prepare  the 
range  of  possible  responses  in  a rapid  manner,  capabilities  such  as 
group  display  conferencing  (where  all  participants  see  the  same 
data) , on-line  data  base  interaction,  and  modeling  or  simulations 
to  develop  projected  consequences  are  required. 

The  capabilities  needed  by  the  decision  naker  are  shown  in 
Figure  10.  The  decision  maker  must  assess  tte  different  options 
available  to  him  and  decide  on  a course  of  action.  In  order  to 
rapidly  initiate  a response,  voice  conferencing  among  all  levels 
of  ccrtnand  is  required  along  with  several  different  display  capa- 
bilities. These  include  the  capability  to  display  force  disposi- 
tion, chronological  events  (including  actions  taken  in  related 
areas  such  as  diplanatic  and  economic) , and  assessments  of  the 
situation  by  kxuth  operations  and  intelligence  in  an  integrated 
display.  In  order  to  ensure  that  all  participants  have  the  sane 
display  data  available  to  them,  ccmon  background  displays  sliould 
be  predefined  and  only  the  parameter  or  synbol  values  transmitted 
for  display  update. 

In  presenting  options  to  the  decision  maker,  the  major  fac- 
tors which  should  be  portrayed  ar  the  length  of  time  and  the  op- 
tions which  are  still  possible  for  execution,  projected  conse- 
quences of  the  option  execution,  risks  involved,  and  anticipated 
cost,  all  of  which  can  be  updated  dynamically  throughout  the 
crisis  situation. 

Once  an  option  has  (aeen  selected  for  execution,  thus  decision 
must  be  transmitted  to  tlie  CINC/force  level  selected  to  carry  out 
the  option.  Key  capabilities  required  at  this  level,  as  sliown  in 
Figure  11,  include  an  acicncwledgment  feature  which  guarantees  that 
the  decision  maker  knows  his  instructions  have  been  recieved,  ard 
simultaneous  operations  monitoring  feedback  to  all  higher  levels 
that  ensures  they  are  fully  aware  of  activities  as  the  option  is 
executed. 

The  top-down  approach  using  situations  and  options  and  a 
characterization  of  tlie  operational  environment  as  the  framework 
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FIGURE  10 

MMXS  CRISIS  DECISION  MAKER  CAPABILITIES 
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yWCCS  CAPABILITIES  TO  SUPPORT  CRISIS  TOTAL  INFORMATION  FLOW 

DECISION  mKER  PRESENTATION/VOICE  CONFERENCE  - 
(CINC,  NAT'L  TRANSPORTABLE  C^) 

DYNAMIC  SIMULTANEOUS  SITUATION  DISPLAY 

o FORCE  DISPOSITION  ~ (GRAPHIC,  PHOTO) 

0 CHRONOLOGICAL  EVENT 

0 ASSESSMENT  (INTEGRATED  OPS/INTELL) 

0 SYMBOL,  PARAMETER  TRANSMISSION 

OPTION  PRESENTATICW 

0 EXECUTION,  VIABILITY  TIME 

0 CONSEQUENCES 

o RISKS 

0 COST 


FIGURE  11 

WWCCS  CRISIS  CINC/FORCE  LEVEL  CAPABILITIES 
MWMXS  CAPABILITIES  TO  SUPPORT  CRISIS  TOTAL  INFORMATION  FLOW 


CINC/FORCE  LEVEL  - COmUNICATICN  CF  DIRECTIVE 

(CINC,  TRANSPCFTABLE  | 

C^,  UNIT,  INDIVIDUAL  I 

PLATFORM)  \ 

I 

0 ACKNaVLEDGMENT  j 

j 

0 OPS  MONITORING  - FEEDBACK  i 
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for  developing  the  WWMXS  architecture  proved  to  be  a sound 
methodology.  It  allowed  early  insights  into  prograrmetic  issues 
which  could  be  brought  to  the  attention  of  the  decision  makers 
and  provided  a level  of  detail  cotmensurate  with  the  decision 
makers'  level  of  selecting  among  alternatives. 
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MAN-MAQIINE  SIMUIATICW  STODIES 
IN  THE  AIR  FORCE 

by  DONAID  A.  TOPMILLER 
WfLlglLt-Puttefiion  Kit  Vofice  Bo-ie 


I.  Int’ioductloK.  Unlike  many  of  the  Air  Force  aeronautical  wea- 
pon systems  which  have  been  based  on  a technology  developed  in 
the  early  1900 's,  systems  are  conparatively  new  (since  Hi  II) 

and  have  primarily  blossomed  in  direct  proportion  to  ccnputer 
science  technologies.  Early  human  engineering  efforts  were  add- 
ressed to  aeronautical  engineering  problems,  aircraft  control  and 
safety  (altimeter  studies) , vAiere  the  hunan  operator  (pilot)  con- 
tributed significantly  to  system  performance.  Since  safety  of 

flight  was  so  preeminent  in  early  engineering  endeavors  for  i 

designing  and  testing  aircraft,  the  man-mchine  conpatibility  pro>- 
blems  were  "roughly  engineered"  by  aeronautical  designers  based 
ipon  their  intuitive  )oncwledge  of  human  performance.  Human  engi- 
neering, as  a discipline,  developed,  nurtured  and  thrived  on 
making  these  "gut  engineered"  designs  more  efficient  and  safe 
through  knowledge  and  data  of  man's  performanc^e  capabilities. 

On  the  other  hand,  systems,  at  least  corputerized  ver- 
sions, have  only  a 25-30  year  history.  Further,  with  the  advent 
and  development  of  ccuputers  to  proc:ess  the  information  in  these 
systems,  the  functions  performed  bec^ame  uniquely  more  "intellec- 
tive", in  an  analogous  sense,  to  human  functicns.  Data  are  input 

to  the  cciputers  (sensed) , stored  (memory) , processed  (problem  i 

solving) , etc.  This  evolution  of  systems  and  the  sister  tech-  ' 

nology  of  ccrputer  scienc:e  was  prone  to  a greater  propensity  to  | 

be  "gut  engineered"  or  to  "bright  idea"  engineering  than  even  j 

aeronautical  systems.  Also,  operational  personnel  constantly  ! 

strove  for  bigger  and  faster  caputers  to  minimize  cycle  and 

processing  times  without  good  evidence  that  the  advantages  to  be  j 

I 
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gained  in  system  effectiveness  warranted  the  e^qaenses.  The 
natural  assunption  is  that  more  rapidly  sensed  and  processed  data 
can  be  used  itDst  effectively  by  operators  and  caimanders  in  the 
field  environnent  without  taking  into  account  the  human's  per- 
ceptual, intellective  and  infomation  processing  conpatibility 
with  the  caiputer.  Therefore,  we  find  new  systems  insisting 
on  2.5  sec.  cycle  tine  of  radar  history  without  good  evidence  that 
this  hardvisrd/software  capability  can  be  effectively  used. 

2.0  Man-ComiJutcA  Jn/joimtion  PtoeeAAtnq  Capahltltie^ . Following 
is  a listing  of  human  information  processing  capabilities  and 
limitations  published  in  a Honeywell  document  (12297-FR)  entitled. 
Information  Professing  Framework  for  Man/Ccmputer  Interaction:  A 
Research  Study,  which  defines  current  state-of-the-art  research 
issues. 

° Man  has  extensive  heuristic  infonration-processing 
capabilities  v*ich  cannot  be  duplicated  by  machine; 
he  is  able  to  apply  creative  solutions  to  unique 
problems  and  to  eliminate  large  numbers  of  alter- 
natives during  the  solution  process  (i.e.,  man 
is  adaptable) . Hie  ocnputer  can  be  used  to 
search  and  retrieve  information  based  on  man's 
direction  and  guidance.  Due  to  its  great 
speed  of  calculation,  the  carputer  can  be  an 
aid  even  when  trial  and  error  may  be  the  only  way 
to  proceed.  , 

o Man's  problem-solving  process  appears  to  contain  a 
randan  element  which  enables  him  to  attempt  solu- 
tions which  may  not  be  a direct  result  of  standard 
rule-follcwing  procedures;  he  is  able  to  innovate 
and,  thus,  may  arrive  at  unpredictable  but  suc- 
cessful, results.  Hie  carputer  could  be  used 
as  a partner  in  this  "ideation”  activity,  by 
reoording  man's  output  and  providing  a mediun 
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for  generating  novel  relationships. 

o Man  requires  a certain  minimum  amount  of  time  in 
vrfiich  to  consolidate  his  thoughts  (i.e.,  perform 
coiplex  processing) ; this  time  is  required  pri- 
marily for  the  transfer  of  information  between 
short-  and  long-term  memory  stores  and  for 
associating  the  infornation  with  the  task  at 
hand.  A nan/ocnputer  system  organized  on  the 
principle  of  memory-to-memory  connunication 
should  increase  the  efficiency  of  this  consoli- 
dation and  association  process. 

» Man  uses  definable  strategies  in  his  information- 
processing activities;  these  strategies  vary  in 
their  rationality  and  effectiveness;  nan's  stra- 
tegies nay  reflect  sane  basic  cognitive  style 
which  is  characteristic  of  an  individual's 
approach  to  a problem  regardless  of  task  specifics; 
some  strategies,  however,  are  modificable  by 
training  or  performance  aids.  In  a ccnputer- 
based  system  where  such  idiosyncracies  form  part 
of  the  data  base,  different  cognitive  styles  would 
not  necessarily  limit  or  handicap  perfomance. 

Itie  less  efficient  strategies  appear  to  place  a 
greater  strain  on  human  memory,  and  this  could 
be  alleviated  by  oonputer-aiding. 

» Man's  performance  appears  to  suffer  when  he  is 
required  to  perform  several  tasks  in  parallel, 
especially  when  the  tasks  are  in  different  stages 
of  cotpletion.  The  catputer's  capability  for 
storage  would  be  an  asset  in  this  regard,  for  the 
system  could  actually  switch  from  tasks  in  various 
stages  of  solution  as  either  relevant  data  were 
received  by  the  systan  or  hunan  "insight"  occurred. 
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o Man  is  limited  in  his  sensory  and  cx>gnitive  ability 
to  deal  with  inooming  infornation,  unless  the  pat- 

!tem  is  regular  and  predictable;  man  has  difficulty 

in  dealing  with  multiple  sensory  inputs.  This  is 
an  exanple  where  an  interactive  system  could 
buffer  the  information  (i.e.,  hold  it  in  queue) 

,i'  until  nan  could  process  the  infomation.  The  system 

could  thus  caipensate  for  the  tendency  of  man  to 
deal  with  infomation  overload  by  selective 
t attention. 

^ » Man  has  a finite  channel  capacity  vhich  limits  the 

amount  of  information  in  a stimulus  configuration 
that  he  can  deal  with  effectively;  as  task  sti- 
(l  mulus  ocrplexity  increases,  perfomance  is 

degraded;  relevant  redundancy  can  help  alleviate 
this  difficulty;  however,  irrelevant  task 
redundancy  has  a disproportionate  interference 

I factor.  Given  the  appropriate  guidelines,  many  of 

these  types  of  problems  could  be  eliminated  by  pre- 
processing the  stimulus  inputs.  The  effects  of 

I various  levels  of  this  approach  on  system  performance 

I and  efficiency  are  not  known  at  present. 

o Man  requires  fairly  ccitplete  information  on  his  per- 
fomence  to  mintain  or  increase  his  effectiveness; 
his  cwn  expectancies  can  exert  a powerful  influence 
vihen  feedback  is  periodic  during  critical  periods  of 
skill  acquisiticai;  man  progresses  from  a require- 
ment for  general  knowledge  of  results  to  a need 
for  specific  task  feedback.  A system  dedicated  to 
interactive  informatics  processing  oould  be  pro- 
gramed bo  adjust  feedback  requirements  relative  to 
the  level  of  perfomenoe  and  his  location  in  the 
task  sequence  (i.e.,  incorporate  principles  of 
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oorputer-aided  instruction) . 


» Ihe  more  deterministic  the  task  environment,  the 
sinpler  the  task  situation  for  nan;  however,  man 
can  effectively  deal  with  ocnplex  proljabilistic 
environments  better  than  can  a cotputer  alone. 

The  optimum  approach  to  ccttplex,  unbounded  pro- 
blems appears  to  be  man/ccnputer  synergism. 

» Seme  relationships  are  more  difficult  for  man  to 
deal  with  than  others  (e.g.,  conjunctive  problems 
versus  problems  based  on  disjunctive  rules) . In 
theory  no  such  differences  should  be  present  when 
man  is  interacting  with  a cemputer  to  solve  such 
problems,  because  the  limitations  due  to  human 
memory  could  be  reduced. 

« Most  human  joeings  are  very  susceptible  to  the 
influence  of  set  or  orientation  generated  by  pro- 
blem pattern,  either  structural  or  temporal;  this 
rigidity  can  loe  evoked  by  relatively  few  occur- 
rences of  particular  events;  the  effect  is  reduced 
by  forgetting,  thus  suggesting  the  locus  of  the 
problem  is  in  memory,  probably  short-term  store. 
The  capability  of  the  computer  to  monitor  behavior 
patterns  would  be  useful  in  developing  rules  for 
alerting  the  operator  (i.e. , "breaking  set"; 
another  area  for  study) . 

» Man  appears  in  many  diagnostic  situations  to  be 
a conservative  infomation  processor  in  that  he 
does  not  use  all  of  the  information  available  in 
input  data  and  accortiingly  tends  to  acquire  more 
data  than  he  either  needs  or  can  use  prior  to 
seme  terminal  b^iavior.  Cciputer  aids  have  been 
proposed  and  inplianented  to  reduce  this  human 
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propensity  by  allocating  to  a machine  those 
tasks  in  which  the  nan  is  more  likely  to  display 
this  tendency. 

o Man's  ability  to  formulate  novel  relationships 
is  reflected  in  the  fact  that  he  is  an  effec- 
tive information  processor  despite  his  cognitive 
limitations;  this  related  to  his  ability  to 
develop  heuristics  for  infomation  reduction 
and  conservation.  Hie  role  of  the  coiputer  in 
this  regard  would  be  as  a vehicle  for  depicting 
these  relationships  and  for  performing  the 
analysis  necessary  for  evaluation  and  verifica- 
tion. 

» Man  has  tieen  found  to  be  more  responsive  to  a 
criteria!  of  accuracy  than  timeliness  vrfien  both 
are  system  parameters.  The  ocnputer  has  the 
capability  to  operate  in  non-real  time  (i.e., 
"fast  time"),  thereby  providing  the  hntian  cpera- 
tor  the  capability  to  evaluate  many  more  alterna- 
tive courses  of  action  within  limited  time 
constraints  without  sacrificing  his  search  for 
accuracy. 

o Hutans  in  decision  situations  tend  to  delay  their 
action  selection  i’^iaj^ropriately;  this  is  espe- 
cially prevalent  when  the  itan  is  at  a relative 
disadvantage.  Again  oonputer-aiding  is  a reaso- 
nable mechanism  for  channeling  the  operator's 
thoi^ht  processes  and  overcaning  this  tendency 
tcward  inertia  in  prc±)lem  solving  and  decision 
naking. 

o ffen  has  a nearly  limitless  edacity  for  variety 
in  his  behavior;  this  is  reflected  in  his  unique 
capacity  for  innovation,  originality,  and  creati- 
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vity;  man  has  a special  capability  in  the  idea- 
generation  aspect  of  problem  solving.  The  con- 
puter  can  enhance  this  process,  but  it  can  by  no 
means  duplicate  it. 

o Man  is  acknowledged  to  be  a superior  pattern 
recognizer  especially  when  the  patterns  are  both 
terporal  and  figural  in  content.  Further,  the 
interpretation  of  patterns,  such  as  voice  ccm- 
municatioii,  relies  ipon  man's  ability  to  con- 
tribute his  own  experiences  to  the  interpretation. 

Thus,  for  the  present,  nan's  role  in  this  regard 
cannot  be  dijplicated  by  machine  but  can  be  enhanced 
by  providing  variable  displays  capable  of  control- 
ling pattern  changes 

3.0  C3  MAN- MACHINE  SVSTEHS  EXPERIMENTS.  Fig  1 shows  a fifteen 
year  history  of  Man-Machine  Ccjirand  and  Control  Simulation  starting 
in  the  early  sixties  with  a program  in  Tactical  Coitnand  and  Con- 
trol decision  aiding  carried  out  under  contract  with  C*iio  State 
University's  Hunan  Performance  Center.  This  program  was  dubbed 
OOMCON  (a  simulated  threat  diagnosis  system)  and  involved  in  an 
early  version  vhich  had  little  feedback  loops  in  the  system  whereas 
the  revised  COMCON  included  an  action  sequence  and  feedback  load 
in  addition  to  threat  evaluation  per  se  and  operated  on  a greatly 
reduced  time  base. 

When  the  OSU  program  was  terminated  in  1968,  it  was  decided 
to  develop  an  in-house  capability  in  the  Aerospace  Medical 
Research  Laboratory  for  Man-Machine  Coimand-Control  Systems 
Research.  The  Human  Engineering  Systems  Simulator  (HESS)  was 
acquired  involving  an  IBM  360-40  conputer  graphics  facility. 

Since  in  the  OSU  program  we  investigated  the  man-machine  diagnostic 
system  behavior  with  very  limiting  assuipticais  of  the  sensor/ 
surveillanoe  environment,  it  was  decided  to  direct  our  systems 
simulaticns  activities  to  the  surveillance,  and  to  sate  extent. 
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HESS  ACQUISITION  IBM-360-40  IBM-370-155 


the  weapcins  direction  functicxis  of  BUIC  III  and  AWACS. 

The  most  advanced  of  our  multi -cperator  cximiand-control  system 
is  reflected  in  our  Remotely  Piloted  Vehicle — Drone  Control 
Facility  Simulation. 

2 illustrates  the  develcfments  of  our  in-hou.se  program  in 
terms  of  the  major  simulations,  the  systems  independent  variables 
manipulated  in  the  simultations  and  the  major  operator  and  system 
performance  measures  taken  (dependent  variables) . 

Ihe  following  sections  will  attempt  to  suimarize  the  research 
problems  and  seme  of  the  more  significant  findings  frem  these 
caiplex  system  simulation  experiments. 

Chip  State  University  GOMCON  Studies 

Ihe  program  at  Ohio  State  University  under  the  direction  of 
Dr.  William  C.  Howell  was  designed  to  assess  the  use  of  oerputers 
to  aid  a decision  process  of  the  kind  that  may  be  found  in  a cem- 
mand-oontrol  system.  Ihis  program  dealt  exclusively  with  diag- 
nostic decision  functions  within  the  context  of  a simulated 
intelligence  threat  evaluation  system. 

Although  the  overall  question  was  addressed  to  determining  if 
the  cdiputer  can  be  used  to  assist  man  made  decisions  in  a 
realistically  caiplex  oonmand-control  situation,  we  were  alcr. 
interested  in  determining  what  aspect  of  the  decision  function 
should  be  autemated  and  hew  much  can  be  gained  by  autemating  these 
functions.  This  is  tantamount  to  asking  hew  the  cemputer  can 
assist  in  the  system  inference  process  as  opposed  to  sinple  pre- 
decisional  data  processing  (tabulation,  storage,  etc.). 

Ihe  general  philosophy  used  to  develop  the  simulaticn  frame- 
wrork  was  not  to  attanpt  diplicating  any  existing  system  however, 
we  did  try  to  simulate  basic  functional  characteristic  of  a high 
level  diagnostic  system  (air  reconnaissance) . By  adopting  such  a 
philosophy,  it  should  be  possible  to  determine  principles  which 
would  generalize  across  a broad  spectrtni  of  such  systems. 

The  simulaticn  vehicle  consisted  of  a 1000x1000  mile  area 
called  an  aggressor  territory  which  was  under  surveillance.  Simu- 
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lated  activities  included  troop  movements,  vehicular  movements, 
etc.,  in  this  area.  The  input  to  the  system  was  the  processed 
reccainaissance  data  about  these  activities.  These  reports  were 
then  analyzed  by  the  system  in  order  to  diagnose  pending  threat 
of  attack. 

The  block  diagram  of  the  systan  is  depicted  in  Figure  3.  In 
general,  the  three  Intelligence  Staff  Officers  (ISO)  attenpted  to 
determine  what  was  present  in  the  environment  based  on  the  recon- 
naissance data  and  report  this  to  the  Ccrmanding  Officer  (00) . 

The  00  evaluated  these  reports  to  determine  vhat  the  data  meant  in 
terms  of  the  aggressor's  plans,  e.g.,  training  maneuver?,  diver- 
sionary action?,  etc.  The  system  output  was  a set  of  probability 
estimates  that  each  of  these  hypotheses  was  true. 

The  diagnostic  process  can  be  conceived  of  as  actually  con- 
sisting of  two  processes:  first,  is  seme  estimation  of  the  bearing 
that  each  bit  of  diagnostic  data  has  tpon  the  states  of  possible 
threat  (evaluation  process) . It  has  been  assumed  tJTat  man  is 
best  suited  to  perform  the  evaluation  function  while  the  computer 
should  perform  the  aggregation.  By  so  doing  man's  special  intui- 
tive skills  can  be  used  for  individual  datvm  evaluaticxi  while  the 
machine's  capability  for  r^id  calculation  and  memory  can  be  used 
best  for  ccmbining  data  to  yield  an  overall  diagnosis.  Tb  accom- 
plish this  latter  function  the  machine  must  be  provided  a rule 
for  determining  hew  the  information  should  be  combined.  The  rule 
used  in  this  program  wcis  Bayes  Theortan. 

The  overall  results  of  this  program  are  sunrerized  in  Table 
1.  In  general  an  inprovement  of  13%  in  correct  diagnoses  is 
achieved  with  automated  over  complete  manual  estimation.  The 
greatest  advantages  of  oonputer-aided  solutions  seem  to  occur 
when  there  is  degraded  input  data  due  to  lew  fidelity  of  sensors  or 
stressful  situations  due  to  the  infoniHtion  load  generated  by  the 
amount  of  data  to  be  processed.  (See  Fig  4) 

ftie  reason  that  the  oenputer  aids  the  man  under  these  situa- 
tions is  that  it  considers  all  of  the  infonration  no  natter  liow 
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degraded  vAiereas  man  tends  to  ignore  all  but  the  highest  quality 
information.  Another  reason  seems  to  be  that  man  is  more  con- 
servative than  the  data  actually  justify.  It  appears,  however, 
that  subjects  can  inprove  in  these  respects  with  training  in  the 
logic  of  an  aggregation  procedure  (Bayesian  technique) . And  they 
seem  to  do  rather  well  if  not  under  a great  deal  of  stress. 

AMRL  Surveillance  and  Vfeapons  Direction  Simulation 

With  the  acquisition  of  the  Human  liigineering  Systems 
) Simulator  (HESS)  in  April  of  1969,  at  that  time  a ccrputer  graphics 

system  (IBM  360-40  with  four  IBM  2250  graphics  scopes)  now  updated 
■ j to  an  IBM  370-155  with  512K  byte  CPU,  the  early  ooramand/control 

simulations  were  addressed  to  surveillance  problems.  Since  the 
CSU  program  emphasized  the  cottmand  decision  functions,  with  a 
highly  abstracted  and  mthenatical  representation  of  the  threat 
environment  it  was  decided  to  concentrate  on  the  sensor-surveil- 
lance end  of  the  systan  of  our  in-liouse  program. 

'BUIC  III  Active  Tracking  Studies 

Early  simultations  focused  on  the  active  tracking  function 
for  a digitalized  radar  sensor  system.  Subject-operators  observed 
a ccnputer  display  unit  simulating  radar  clutter  and  radar  trails 
I of  aircraft  of  differing  penetrating  velocities  (150K  and  500K) . 

Padar  information  was  stored,  cycle  by  cycle,  vp  to  a limit  of 
f 3,  5,  7 or  9 twenty  second  cycles  and  then  presented  sequentially 

i rapidly  enough  to  give  apparent  perceptual  novement  in  the  track/ 

trails.  Subject/operators  initiated  tracks  on  tie  aircraft  and 
controlled  ccirputer  processing  by  light  pen  and  keyboard  actions. 
Since  only  portions  of  the  total  BUIC  III  active  tracking  function 
could  be  simulated  on  the  HESS,  other  actual  tasks  were  simulated 
by  a stochastic  ccnputer  model  (Siegel  and  Vtolf,  1963).  Ihe 
Siegel-tiiolf  model  is  a coiputer  program  for  generating  a sanple 
tine  for  a task  by  a Monte  Carlo  nethod.  When  task  equipment  is 
in  the  planning  stage,  being  developed  or  not  physically  present, 
f the  Siegel-ltolf  model  can  generate  realistic  task  times  on  that 
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equipment.  Fig  5 shews  the  findings  of  this  simulation.  Note 
that  probability  to  detect  was  less  and  average  time  to  initiate 
tracks  was  longer  for  the  slower  aircraft.  It  appeared  that  there 
was  little  advantage  to  have  more  than  seven  returns  per  trail  in 
the  track,  both  in  terms  of  times  to  initiate  ard  probability  of 
detection.  IWo  significant  points  seem  to  derive  from  this  effort; 
first,  using  both  cerputer  simulation  of  tasks  vhich  could  not  be 
physically  simulated  in  sequential  combination  with  physical 
real-time  simulation  that  significant  sensor  system  effects  on 
opjerator  pierformance  could  be  demonstrated  and  secondly,  such  a 
simulation  approach  can  provide  the  trade-off  data  for  deciding 
how  much  ocirputer  processing/storage  is  required  to  optimize 
operator  surveillance  detection  performance. 

‘AWRCS  Surveillance  Studies 

Early  in  1970  the  Airborne  Warning  and  Control  System 
(AWACS)  System  Projeert  Office  (SPO)  requested  that  .’JIRL  investigate 
surveillance  operators  ability  to  detect  and  initiate  tracks  on 
targets  with  varying  degrees  of  ground  and  sea  clutter.  A series 
of  simulation  studies  was  initiated  to  investigate  various  sensor 
and  radar  filtering  design  issiKS.  Fig  6 shows  seme  early  results 
from  these  studies  on  an  operator's  probability  of  correct  track 
initiation  as  a function  of  the  nuirber  of  tracks  he  had  to  main- 
tain throiJighout  a fifty  minute  mission.  It  can  be  seen  that  under 
varying  clutter  density  levels  and  varying  target  introduction 
rates  into  a 75x75  nautical  mile  surveillance  zone  that  the  more 
targets  the  operator  had  to  maintain  track  on,  the  greater  the 
probability  of  initiating  new  targets  entering  the  zone.  Also 
Fig  7 shews  some  results  of  these  same  studies.  Probability  of 
correct  initiation  of  penetrator  targets  is  plotted  as  a function 
of  target  introducticxi  rate  and  clutter  density.  Note  that  in  the 
worst  case  condition,  vhen  p^netrators  are  entering  the  surveil- 
lance zone  at  four  per  minute  and  clutter  density  is  fairly  high, 
that  one  out  of  ten  of  enery  attackers  will  penetrate  our  surveil- 
lance zone  undetected. 
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In  addition  to  the  questions  fron  the  SPO,  on  the  ability  of 
a single  operator  to  detect  and  initiate  targets  in  high  land/sea 
clutter  conditions,  we  were  ccncemed  with  the  possible  advantages 
in  adding  additional  operators  to  riDnitor  the  same  surveillance 
area.  Fig  8 illustrated  several  points  from  the  multi-operator 
studies.  First,  two  measures  of  performance  were  taken  in  the 
simulations — an  operator  performance  measure,  mean  first  good 
initial  time  (MFXjIT)  or  the  average  time  it  takes  the  operators  to 
initiate  targets  and  an  overall  good  tracking  score  (GT) , which 
is  a systems  measure  containing  both  operator  performance  and 
conputer  tracking  performance.  Both  of  these  neasures  were  plotted 
as  a function  of  nonber  of  operators  1-3  and  a radar  system  para- 
meter, prc±iability  of  track  failure  (POTF) . It  should  be  evident 
that  the  systems  designer  and/or  cotnmander  might  reach  two 
entirely  different  conclusions  about  vdrether  or  not  to  have  mul- 
tiple operators  survey  the  sane  area  as  a function  of  radar 
perfomance  (i.e.  prctobilities  of  track  failure) . There  is 
little  advantage  to  adding  additional  operators  if  overall  good 
tracking  is  of  primary  concern,  but  a significant  advantage  if 
identifying  and  initiating  tracks  (operator  measure)  is  of  primary 
concern.  Further  the  e^qienses  involved  in  inproving  radar  track 
failure  (sensor  parameter)  only  has  its  effect  on  overall  good 
tracking.  The  issue  of  deciding  to  use  only  an  operator  measure 
or  a system  measure  must  be  negotiated  between  the  system  designers, 
R&D  managers  (SPO)  and  the  operational  using  ccmmand. 

*AI®CS  Weapons  Direction  Simulation 

A natural  follcw-on  to  the  surveillance  study  effort  was  to 
(1)  obtain  data  on  weapons  controller  performance  in  a simulated 
weapons  management  simulation  and  (2)  conpare  alternative  methods 
for  mediating  information  inputs  to  a ccaiputer  via  an  associated 
CRT  display  of  aircraft  status  information  based  on  digitalized 
radar  returns. 

The  principle  experimental  variable  investigated  was  the 
method  of  indicating  points  on  the  CRT  display  interface  which 
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mediated  transferral  of  data  between  the  operator-controller  and 
odiputer  system.  Three  methods  were  investigated:  (1)  a hand- 
held pen  with  fiber  optics  link  to  the  oonputer  system,  (2)  a 
track  ball  cursor  controller,  and  (3)  a force  stick  cursor  con- 
troller. 

The  task  used  in  the  simulation  required  the  weapons  con- 
trollers-operator  to  direct  up  to  10  friendly  interc^tors  against 
attacks  by  enemy  bcmbers.  Five  of  the  fighters  were  in  the  air 
as  the  simulation  began.  Each  had  an  airspeed  of  500  knots  and  an 
altitude  of  10,000  feet.  The  enat^  bcmbers  entered  frcan  the  west 
side  of  a 200  x 200  mile  area  and  were  distributed  randcmly  along 
the  200  mile  boundary  upon  entry  and  traveled  in  a generally 
easterly  direction  toward  a bonb  release  line  (BRL)  which  spanned 
the  display  frcm  top  to  bottom  (north  to  south)  at  a point  185 
miles  east  of  their  entry  points.  Eneny  bombers  entered  with  an 
airpseed  of  500  knots  and  air  altitudes  of  40,000  feet. 

The  controller-operator's  prinary  task  was  to  direct  the 
fighters  to  intercept  and  "kill"  the  attacking  bcmbers  as  far  from 
the  BRL  as  possible.  In  addition  to  the  experimental  variables  of 
light-pen,  track-ball  and  force  stick  methods  of  interaction,  a 
second  experimental  variable  of  "load"  was  manipulated.  Three 
levels  were  investigated.  The  first  load  condition  was  charac- 
terized by  an  attack  involving  a single  wave  of  16  bcmbers. 

Under  the  second  load  condition,  2 waves  of  20  bcrtiers  attacked 
with  approximately  6 1/2  minutes  elapsing  between  waves.  Load 
three  was  a single  wave  of  40  botbers  all  entering  the  display 
area  within  the  first  3 minutes  of  the  session. 

The  performance  measures  included:  nuntoer  of  kills,  average 
distance  frcm  BRL  at  kill,  fighters  dcwn  for  lack  of  fuel,  fuel 
used  and  mitter  of  c^^erator  actions. 

Figs  9 and  10  show  the  ocmparative  effects  of  the  three 
modes  of  interacting  with  the  computer  generated  display  as  a 
function  of  load  condition.  Note  that  both  in  terms  of  average 
distance  frcm  BRL  at  "kill"  and  the  fuel  used,  that  the  light  pen 
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was  si.5)erior  tX5  track-ball  and  force  stick.  It  is  evident  that  1 

i 

the  randcm  access  nature  of  the  li^t  pen  is  svperior  for  per-  j 

forming  a weapons  control  task.  It  is  also  interesting  to  note  ] 

that  the  2/20  and  1/40  load  conditions  were  approx inately  an  ! 

equal  wDrkload  for  the  control lers.  j 

■RPV  E)rone  Control  Data  Retrieval  System  Studies  i 

Our  most  advanced  and  highly  evolved  Man-Machine  System 
Simulation  is  represented  by  our  in-house  attesnpts  to  answer  key 
questions  about  operator/system  control  capabilities  for  a 
Remotely  Piloted  Vehicle  (RPV)  Drone  Control  and  Data  Retrieval 
Syst«n.  Initial  concerns  of  the  RPV  System  Program  Office  (SPO) 
at  Aeronautical  Systems  Division  centered  around  issues  dealing 
with  the  nimber  of  RPVs  an  operator  or  team  of  operators  could 
control  to  perform  strike,  electronic  warfare,  and  reconnaissance 
missions. 

Fig  11  depicts  the  major  elanents  of  the  multi-cperator  RPV 
simulation.  It  contains  five  major  system  ccitponent  structures. 

At  the  center  of  the  system  is  the  Huian  Engineering  Systems 
Simulator  (HESS)  which  provides  all  of  the  najor  parametric  con- 
trol, A/D  and  D/A  conversion,  graphics  di^lay  aixl  terminal  pilot 
station  control.  The  other  ccnponents  include  the  major  systan 
parameters:  ip  to  35  RPVs,  reading  velocity  and  altitude,  3 data 
links,  s\jbsystem  failures,  3 navigational  systems  and  fuel  orai- 
smption;  4 midoourse  operators  vdio  provided  navigational  patches, 
phase  transition,  fuel  management  and  responded  to  RPV  subsystem 
failures;  a terrain  model  which  had  closed  loop  TV  camera  control  | 

multiple  strike  targets  and  different  video  data  links;  and  I 

finally  the  terminal  strike  operator  who  flew  the  birds  to  the  ] 

target. 

Results  from  a series  of  simulations  in  vhich  system  peura- 
meters  were  varied  over  the  craiditions  of  interest  to  the  SPO 
indicated  that  operators  could  control  ip  to  four  RPVs  simulta- 
neously and  still  meet  the  navigational  cross  track  error  limits 
and  still  hand  off  to  a terminal  operator  at  the  designated  way 
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points.  Hcwejver,  systems  perfonrance  could  be  enhanced  by 
providing  autcmatic  heading  correction  and  a means  for  "anoothing" 
RPV  position  reports. 

It),  in  part,  verify  the  results  achieved  in  the  operator(s) 
in-the-locp  real-time  simulation  and  to  establish  verification  of 
our  Man-Machine  Ccitputer  simulation  methodology  and  language;  a 
SAINT  (Systems  Analysis  Integrated  Network  of  Tasks)  model  and 
single- team  simulation  was  developed  for  the  RPV  system. 

Figs  12  and  13  shows  the  23  RPV  flight  perfomance  measures 
and  the  15  operator  control  performance  measures  respectively 
that  were  measured  in  the  real-time  simulatiwi.  ihese  same 
neasures  were  used  for  SAINT  model  predictions.  The  sairple  model 
validation/verification  results  are  displayed  in  Fig  14.  Note 
that  in  all  cases  the  real-time  RPV  simulation  values  for  a given 
team  of  operators  over  multiple  missions  fall  within  the  95% 
confidence  limits  of  the  SAINT  model  predictions  for  the  flight 
performance  measures  and  the  operator  control  measures. 

By  building  a SAINT  conputer  simulation  model  of  such  a cotiplex 
multi  parameter  and  multi-operator  system  we  were  able  to  uncover 
sane  defects  in  the  initial  real-time  simulation.  Fig  15  shows 
the  interactive  process  between  physical  real-time  simulation  and 
computer  modeling  in  pseudo  time.  Both  the  system  e^q^eriments 
and  the  systems  designer  can  use  and  benefit  fron  such  an  inter- 
active process. 

4.0  SutmoAii.  In  reviewing  the  fifteen  year  history  of  Man- 
Machine  simulation  in  the  Air  Force  we  might  conclude  that 
from  the  sensed  eneity  tactical  environment  through  the  system 
to  the  Commander  or  Ccrmand  authority  that  the  problems  fall 
into  three  major  areas:  real-time  requirements  of  the  sensed 
environment;  the  threat  detection  process  and  the  threat  assess- 
ment and  oomrand  decision  making. 

Real-Time  Requirement  - The  operational  problem  rests  with 
the  ability  to  optimize  the  cycle  times  between  the  sensed  data 
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21.  AVERAGE  CROSS  TRACK  ERROR  AT  S FOR  S RPVs 

22.  AVERAGE  GROUND  SPEED  ERROR  AT  S FOR  S RPVs 

23.  AVERAGE  CROSS  TRACK  ERROR  FROM  H AT  PILOT  CONTROL  FOR  S RPVs 
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in  the  threat  environment  and  the  operator ' s/cctnmander ' s ability 
to  gain  access  to  this  information  in  an  interactive  fashion. 

The  raw  sensed  data  must  be  processed  and  transformed  into 
usable  information  (e.g.,  track  history  for  surveillance  opera- 
tors or  interceptor  availability/capability  for  weapons  directors) 
Normally,  it  is  assumed  that  the  best  design  is  one  which  mini- 
mizes access  and  cycle  time.  Evidence  from  simulations  and 
operaticnal  environnEnts  suggest  that  cycle  times  less  than  2-5 
seconds  for  normal  digitalized  radar  surveillance  track  loads  are 
useless  ocmputer  capacity.  Hie  expense  in  realizing  these  high 
ocnputer  speeds  may  not  be  warranted  in  terms  of  systems  effec- 
tiveness criteria  such  as  probability  of  detection  Pp. 

Threat  Detection:  The  operational  prthlem  is  ttiat  the 
probability  of  detection  is  less  than  1.00,  <1.00.  The  causa- 

tive factors  are  to  be  found  in  hardware  (e.g.,  radar  sensing 
capability,  caiputer  capacity  arxi  speed,  etc.)  in  human  operators 
(e.g.,  perceptual  discrimination  between  clutter  and  targets, 
ability  to  iiandle  high  target  introduction  rates,  etc.)  and  soft- 
ware (e.g.,  radar  filtering  algorithms,  radar  coiTelational 
algorithms,  etc.).  Lack  of  data  in  these  three  areas  and  their 
interactions  make  it  inpossible  to  specify  optimal  system  design 
parameters. 

Threat  Assessment  and  Cottitand  Decision  Making:  Tbday  full 
advantage  of  coiputerized  decision  aids  is  not  inplenented  in 
ooinnand  and  control  systems  although  they  are  in  effective  use 
in  the  intelligence  cannunity.  Tb  assert  that  maximum  decision 
effectiveness  is  not  laeing  achieved  in  advanced  systems, 
inplies  that  a quantitative  rather  than  a qualitative  staixiard 
of  performance  can  be  developed.  Such  a standard  has  been  deve- 
loped based  on  Bayes  Theorem,  inplicit  in  whidi  ccmputer 
assistance  techniques  are  available  (e.g.,  the  ccrputer  can  per- 
form certain  ccnputations,  in  this  case,  data  aggregations  to 
unburden  the  comander  in  minimizing  the  uncertainty  of  the  data 
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available  to  him  which  bear  on  the  decision  alternatives) . 
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CASE  STUDY  IN  INTEEDPFfiABILITY  MANAGEMENT 


by  COimEL  THOMAS  H.  THOMPSON 
Langlaj  AFB 


1.0  What  li  IrUeA-ope/iab-ifyiti/?  Before  starting  a discussion  of 
intercperability,  let  me  establish  a frame  of  reference  and  give 
you  the  Tactical  Air  Forces  Interoperability  Groipi  (TAFIG)  under- 
standing of  the  meaning  of  interoperability.  Within  TAFIG,  we 
use  the  NATO  definition  fror.  Allied  Tactical  Publicaticm  33  as  our 
starting  point  (Figure  1) . We  further  stress  the  point  made  in 
the  DoD  definition,  wherein  "the  degree  of  interoperability  should 
be  defined  vdien  referring  to  specific  cases"  (Figure  2) . In  other 
words,  interoperability  is  not  an  all-enocrpassing  thing  and 
should  be  distinctly  limited  to  a desired  or  required  level . 

Figure  3 reflects  the  general  aspects  of  interoperability 
which  must  be  considered  when  working  the  problem  of  defining  the 
desired  or  required  degree  of  interoperability  to  be  achieved.  We 
have  tended  in  the  past  to  generally  consider  only  the  mechanical/ 
electrical  interface  noted  between  MCOEM's,  and  typically  we 
expend  much  effort  in  wrestling  with  message  formats.  TAFIG  is 
working  the  problem  from  the  data  interpretation  stan<^int  by 
first  determining  what  information  is  wanted  or  needed  to  be 
exchanged  between  elements  and  then  working  toward  the  mechanical/ 
electrical  connection  to  accomplish  the  exchange.  In  this  manner, 
we  believe  the  system  design  can  be  more  clearly  defined  at  the 
outset. 

Our  viewpoint  is  stpported  by  the  Coinnand  Control  Infontation 
Processing-85  Stutfy,  CCIP-85.  Volone  VIII  of  this  Air  Force  Sys- 
tems Comand  study  points  out  the  basic  problem:  the  interface 
requirements  of  a system  are  normally  addressed  last.  As  a result, 
the  inpact  on  the  systan  is  significant  and  the  degree  of  ii.ter- 
operability  is  carprcmised.  This  approach  toward  interoperability 
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appears  to  be  a result  of: 

- Inadequate  direction  by  the  user  as  to  what  systans  should 
interface. 

- Inability  of  the  user  or  designer  to  define  characteristics 
of  an  interface. 

- Requirements  people  lacking  a detailed  knowledge  of  our 

2 

cwn  C systems  and  of  other  services'  or  nations'  current 
2 

or  projected  C systems. 

Volume  VIII  goes  on  to  note  that  as  a result,  the  require- 
ment or  design  tends  to  be  conceived  as  a single  systan  operating 
by  itself.  In  those  cases  vhere  interface  requirements  have  been 
defined,  the  coordinaticm  cycle  up  through  service  departnents  has 
resulted  in  only  the  minimum  capability  being  approved.  Inter- 
operability requirements  tend  to  be  treated  as  nonessential  "gold 
plating".  A valid  ctojection  to  defining  interoperability  require- 
ments early  for  a system  is  the  obvious  problem  of  having  to 
coordinate  requirements  within  a service  and  between  services  or 
nations.  Additionally,  interface  functions  utilize  hardware  and 
software  viiich  might  inhibit  further  grcwth  or  improverents. 

The  net  result  is  that  intra-  and  interservice  interopera- 
hility  is  not  addressed  in  depth  until  the  developing  systan  must 
be  coordinated  with  other  services  or  processed  by  the  Joint 
Chiefs  of  Staff  (JCS) . Interoperability  then  becones  an  add-on 
to  the  system  and  a deterrent  to  early  fielding  of  the  singular 
system  capability. 

The  aciP-85  study  clearly  points  out  the  need  to  establish 
interoperability  requirements  in  the  conceptual  phases  of  system 
development.  The  study  concern  was  driven  principally  by  soft- 
v«re  development.  Hovrever,  the  point  is  made  that  interopera- 
bility must  be  worked  throughout  the  full  life  cycle  of  any  given 
system.  Shewn  in  Figure  4 are  the  life-cycle  phases  with  appli- 
cable decision  points  for  any  large  system.  Interoperability  must 
be  a specific  oonsideration  at  each  stage  as  we  learn  about  the 
system  being  developed  and  eitployed.  Software,  which  is  the  key 
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BASELINE  BASELINE  BASELINE  BASELINE 

Figure  4 


to  modem  ccmtand  and  control  systans,  follows  the  same  cycle  with 
different  names  attached,  as  shown.  Management  of  the  baselines 
with  interoperability  considered  is  probably  our  most  difficult 
task. 

Surprisingly,  another  prctolem  is  that  current  interoperability 
I efforts  rely  boo  heavily  on  the  inplanentation  of  a coitnon  JCS 

; message  standard,  such  as  those  in  JCS  Pub  10.  The  inplication  is 

that  if  a new  systan  inplements  TADIL-A  or  TADIL-B  messages  or  a 
new  standard  such  as  that  proposed  for  the  Joint  Tactical  Infor- 
j nation  Distribution  Systan  (JTIDS) , interoperability  therefore 

follows. 

Although  the  use  of  a caimon  message  standard  is  an  essential 
part  of  interoperability,  it  is  an  oversinplification  to  inply 
that  such  a standard  is  sufficient  to  ensure  intercperability, 
much  less  joint  operational  effectiveness  of  the  interfaced  sys- 
tems. 

2.0  How  Vo  U/e  Acfeieue  JnteAopeAa.b.LLiXii?  Now  that  I have  estab- 
lished an  understanding  of  viiat  I mean  by  intercperability,  I 
will  take  you  through  seme  of  the  nore  recent  background  efforts 
to  achieve  interoperability. 

Elrphasis  on  the  requiranent  to  interface  or  tie  automated 
systems  together  appears  to  have  reached  a focnos  in  the  1950' s, 
with  individiaal  services  exchanging  digital  data  between  opera- 
tion centers.  Successful  interfaces  were  achieved  in  the  early 
1960's  by  the  Army  Missile  Control  System  and  the  Air  Force 
412L  System  in  Europe.  The  Navy  and  Msurine  Corps  also  achieved 
a high  degree  of  interoperability  during  this  same  time  frame. 

In  the  continental  United  States,  the  Air  Force  Air  Defense  Com- 
mand SAGE  sites  successfully  operated  using  data  links  with  Amy 
Air  Defense  Cermand  Posts.  These  efforts  obviously  were  unilate- 
ral or  bilateral  programs  with  limited  objectives  in  mind. 

The  first  major  attempt  at  joint  service  oeprations  was  the 
Southeast  Asia  interface  directed  by  DoD/JCS  in  mid-1967.  The 
Air  Force  was  designated  cis  the  executive  agent,  and  the  Tactical 
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Air  Control  Systems  aiployed  in  Southeast  Asia  vjere  digitally 
interfaced  using  the  JCS  Pub  10  TADIL  as  the  beisis.  This  inter- 
face, bom  in  the  press  of  ccmbat,  used  systems  that  each  service 
had  independently  developed.  It  put  than  together  through  the 
genesis  of  ^ hoc  vrorking  grovpjs  and  the  establishment  of  a special 
test  force  to  polish  the  interface  prior  to  deploying  to  Southeast 
Asia.  The  system  while  deployed  continued  to  grow  and  improve  as 
deficiencies  were  noted.  One  thing  became  apparent  in  this  pro- 
gram: it  required  a great  deal  of  coordination  by  various  con- 
mittees  to  mutually  bend  and  modify  the  individual  service  systans 
to  achieve  a workable  interface.  Also  required  was  an  understand- 
ing by  each  participant  of  the  other  services'  capabilities. 

The  next  major  step  in  the  interoperability  trciil  came  with 
the  establishing  of  the  TACS/TADS  Program.  TACSAads  is  an 
acronym  for  Tactical  Air  Control  Systans/Tactical  Air  Defense  Sys- 
tans. The  program  came  about  because  the  Air  Force  was  developing 
the  407L  program  to  provide  an  inproved,  manual  ocntrol  systan 
capability  that  vias  mobile  or  deployable.  The  other  services 
expressed  concern  to  DDR&E  in  late  1966  that  the  Air  Force  would 
have  only  a voice  capability  for  the  exchange  of  information, 
viiile  they  were  planning  to  use  digital  caimunications.  This 
concern  culminated  in  a December  1966  DDR&E  mano  directing  the 
Air  Force  to  ensure  that  digital  links  would  be  available  and  that 
these  . nks  vrould  conform  to  JCS  Pub  10,  Tactical  Ccrmuni cation 
and  Control  Systems  Standards.  An  ^ hoc  grotp  was  formed  in  the 
spring  of  1967  to  identify  preplans,  and  special  studies  were 
assigned.  With  the  cAvious  intention  of  getting  something  done 
in  a hurry,  service  groips  atterpted  to  define  what  had  to  be 
done.  It  quickly  became  apparent  that  the  services  could  not 
agree.  The  ranainder  of  1967  was  spent  by  the  services  trying  to 
reach  agreement  on  this  point.  By  Novertjer  1968,  Mr.  Paul  Nitze, 
then  Assistant  Secretary  of  Defense,  generated  a new  program  which 
^}ecifically  stated  a need  for  joint  testing  and  danonstraticxi  of 
oonpatibility  and  joint  effectiveness  of  the  four  service  systans. 
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Based  on  this  guidance,  the  JCS  in  February  1969  established  the 
Joint  TACSAADS  Program,  designating  the  Chief  of  Naval  Operations 
as  the  executive  agent  with  the  responsibility  for  ensuring  that 
the  tactical  interface  was  achieved  and  to  conduct  tests  to  demon- 
strate these  parameters  in  an  operational  envirorment.  The  execu- 
tive agent  established  a joint  interface  test  force  to  supervise 
the  development  of  digital  information  standards  for  the  several 
systans  and  to  conduct  a test  program  v*iich  would  demonstrate  that 
all  the  systems  could  beneficially  exchange  informaticn  by  data 
links. 

Let  me  digress  a mcment  and  note  that  at  the  same  time  this 
was  going  on,  a program  called  WESTPAC  NORTH  also  began  and  was 
based  on  a technical  arrangement  between  the  Government  of  the 
United  States  and  the  Government  of  Japan  relating  to  the  Badge 
System  Program.  This  program  was  essentially  doing  the  same  thing 
as  TACSAADS,  with  the  Japanese  System,  the  Navy  Tactical  Data 
System  and  Airborne  Tactical  Data  System,  and  the  Marine  Tactical 
Data  Systan  interfacing  with  the  manual  Korea  Air  Defense  System 
and  the  manual  Okinawa  Air  Defense  Systan.  We  vrere  obviously 
learning  the  advantages  of  interfacing  and  also  discovering  the 
problems  in  achievement.  I will  say  no  more  about  this  program, 
as  it  was  less  conplex  than  the  TACSAM)S  Program,  which  better 
illustrates  the  difficulties  in  interfacing  tactical  data  systems. 
There  is  also  a significant  effort  on-going  in  the  NATO  ccmtnunity, 
which  is  the  subject  of  a coiplete  briefing  within  itself,  con- 
sidering the  international  conmittees  along  with  technical  and 
funding  issues. 

The  Chief  of  Naval  Operations  early  in  1969  assigned  an 
executive  agent  and  established  the  Joint  Interface  Test  Force 
(JITF)  in  San  Diego.  JITF,  drawing  heavily  on  the  people  v^ho  had 
worked  the  previous  Southecist  Asia  interface,  established  its 
initial  effort  as  the  publication  of  an  Interface  Management  Plan, 
a Technical  Interface  Concept,  a Technical  Interface  Design  Plan, 
and  a Joint  Interface  Test  Plan.  Our  present  experience  tells  us 
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these  basic  dcxxBtients  are  the  kinds  of  things  we  need  to  work  in- 
terface programs,  so  I wil]  outline  briefly  vdiat  they  are.  (See 
Figure  5.) 

The  Interface  Management  Plan  establishes  management  policies, 

procedures,  and  organizations.  It  identifies  responsibilities, 

tasks,  and  documents  required  of  each  participating  test  unit.  It 

further  identifies  unique  sv^port  and  program  milestone  schedules.  \ 

1 

Probably  more  inportant,  it  establishes  a systan  of  interface  | 

software  configuration  control.  i 

The  Technical  Interface  Concept  document  describes  the  partic- 
ipating system  elements  of  the  interfacing  systans  - specifically, 
broad  interface  configurations  - and  describes  the  interface  func- 
tions in  terms  of  elements  of  operational  information  to  be  ex- 
changed. It  also  establishes  a basis  for  interface  management 
functicns  required  during  the  test  program. 

The  Technical  Interface  Design  Plan  (TIDP)  provides  the  basic 
design  criteria  for  the  interface.  This  plan  defines  and  itemizes 
the  messages  and  data  elements  to  be  exchanged,  integrates  the 
data  exchange  inplementation  plans  of  the  interfacing  system,  and 
defines  the  required  interface  processing  procedures.  The  plan 
includes  systan  descriptions,  intersystan  performance  criteria, 
and  systems  capability.  The  TIDP  is  maintained  as  the  standcird 
for  configuration  control  or  management. 

The  Joint  Interface  Test  Plan  establishes  the  philosophy  and 
sccpe  of  the  test  program.  It  specifies  the  test  objectives  for 
each  test  phase  and  establishes  three  basic  phases.  The  first  of 
these  is  qualification  testing  to  confirm  that  connunication  sub- 
systans  function  properly,  that  data  links  can  be  established,  and 
that  digital  data  can  be  exchanged.  Interface  design  testing  is 
the  second  phase,  and  is  conducted  to  prove  the  design  of  the 
interface  and  to  confirm  that  each  service  has  correctly  inter- 
preted and  implanented  the  Technical  Interface  Design  Plan  in  their 
respective  systems.  The  third  phase,  the  technical  interface  con- 
cept testing,  is  conducted  to  ccnfirm  that  the  participating  sys- 
tems are  interoperable  and  that  the  interface  is  ready  for  an 
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operational  effectiveness  demonstration  under  field  conditions. 

The  last  document  on  the  list  ccncems  possibly  the  most 
iiTpDrtant  facet  of  interoperability  - the  developnent  of  proce- 
dures that  "people"  c^jerate  with.  The  test  force  develops  pro- 
cedures that  functionally  demonstrate  the  operation  of  the  inter- 
face in  a test  environment.  Let  me  emphasize  the  "test"  environ- 
ment. Those  procedures  we  develop  in  this  somevthat  sterile  situ- 
ation with  specially  trained  people  eire  considerably  different 
from  those  needed  in  the  field,  vhere  we  are  operating  with  many 
levels  of  skills  and  several  hundred  people  involved  in  veurious 
parts  of  the  operation.  We  have  found  it  is  necessary  to  rework 
and  redescribe  the  required  procedures  to  operate  and  interface 
in  a field  environment  with  normal  field  terminology.  We  some- 
times forget  the  total  numbers  of  people  operating  in  a joint 
combat  force  and  that  their  perspective  is  somevdiat  different 
from  ours  in  the  test  or  laboratory  world. 

Ncv7,  obviously,  all  of  this  does  not  happen  without  consid- 
erable conmittee-type  work,  and  the  management  organization  is 
established  around  several  cormittees  at  different  levels  to  work 
out  the  details  and  achieve  consensus.  These  grorps  face  all  of 
the  pressures  and  concerns  generally  attributed  to  grotp  decision- 
making: 

- Escpenditures  of  additional  and  scarce  funds  strongly 
influaicing  the  merttjers'  votes; 

- Protection  of  one's  self-interest  - or  "Don't  let  the 
blame  for  failure  fall  on  us"; 

- The  general  tendency  to  bring  a panel  of  experts  to 
protect  your  negotiator  and  discredit  the  other  side's 
approach. 

However,  there  is  a feedback  loop  established  in  the  process,  and 
in  spite  of  all  the  pressures  working,  we  achieve  a level  of 
success. 

There  are  three  ccmnittees  that  are  key  to  TACSAADS  manage- 
ment, as  shewn  in  Figure  6.  The  cdimittees  operate  in  a closed 
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loop.  For  purposes  of  illustration,  I will  start  with  the  Joint 
Analysis  Group,  or  JAG.  This  group  reviews  the  results  of  testing 
required  in  the  various  phases  of  the  program  which  I mentioned 
earlier.  Assuming  that  a difficulty  is  noted,  the  JAG  evaluates 
the  discrepancy  and  recaimends  a technical  fix.  Once  agreed  to, 
this  fix  is  forwarded  to  the  Interface  Configuraticn  Control  Board 
for  a review  of  the  inpact  on  the  various  service  systems.  Again, 
assuming  that  the  fix  is  acceptable  to  all  manbers,  their  recoti- 
mendations  are  forwarded  to  the  Executive  Ccmnittee  at  the  service 
level  for  formal  review  and  approval.  This  level  of  actiar  is 
required  for  comnitment  of  funding  and  modification  of  service 
programs  as  required. 

If  the  fix  is  approved,  it  then  goes  back  to  the  Configura- 
tion Control  Board  for  incorporation  into  the  Technical  Design  Plan. 
It  is  further  verified  during  an  approved  test,  analyzed  by  the 
Joint  Analysis  Group,  and  reported  accordingly.  As  noted  in  Fig- 
ure 6,  unanimcus  vote  is  required  at  each  level  on  any  subject. 

A minority  report  is  forwarded  for  adjudicaticn,  and  we  have 
actually  had  cases  taken  to  the  JCS  for  final  judgnent. 

The  inportant  point  to  ranember  is  that  the  joint  product  of 
interfaced  systems  can  be  no  better  than  the  weakest  link.  When 
you  are  dealing  with  various  service  missicn  requirements,  you 
are  working  against  those  specific  needs  of  a service  to  meet  its 
twn  particular  mission,  which  is  directed  by  law.  In  other  words, 
each  service  must  do  its  job  and  has  an  organization  and  budget 
to  support  that  job.  Joint  or  unified  comands  do  not  enjoy  this 
luxury  and  therefore  must  work  toward  a median  solution  for  all. 

We  are  approaching  the  operaticxial  field  demonstration  of 
TACS/TADS,  now  scheduled  for  the  spring  of  1977.  The  activity 
levels  are  increasing  as  we  bring  more  and  more  pjecple  into  an 
understanding  of  their  training  needs  for  the  interoperation  of 
TACS/TADS.  Each  participant  must  understand  a considerable  por- 
tion of  the  other  services'  systems  in  addition  to  being  expert 
in  his  own. 
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3.0  Suitminq  Up.  In  the  precedinj  pages,  I have  tried  to  describe 
what  interoperability  is  and  enphasize  that  specific  levels  of 
interoperability  trust  be  negotiated  and  stated  at  the  inception 
of  a system  program.  Once  defined,  extensive  coordination  is 
required  by  a dedicated  organization  throughout  the  life  cycle  of 
the  system  frcm  conceptual  idea  through  its  continuing  maintenance 
in  field  operating  locations.  The  TMTS/TADS  man'gement  system  is 
not  an  ultimate  systan;  however,  it  works,  and  a lot  of  midnight 
oil  has  been  burned  in  achieving  the  working  relationships  needed. 

In  closing,  there  is  one  more  thought  that  I must  leave  with 
you,  and  that  is  the  consideration  of  interoperability  require- 
ments between  ourselves  and  allied  nations.  This  is  particularly 
true  in  NATO.  However,  a word  of  caution  is  inportant  here,  in 
that  our  total  requiranents  cannot  be  driven  by  that  unique 
environment;  vre  nust  account  for  other  environments  that  may  be 
more  or  less  sophisticated. 
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Hartley:  Using  this  system,  man-machine  system,  to  evaluate  the 
ccitparative  merits  of  progress  which  are  anployed  in  the  machine 
part.  Is  system  A better  than  systan  B?  Or  is  it  just  a fact 
that  system  A is  better  than  System  B for  certain  operators?  Hew 
is  this  resolved.  As  statisticians,  we  call  that  an  interaction 
between  the  hardware  systan  and  the  operators.  My  second  ques- 
tion refers  to  the  very  interesting  PERT  simulation.  I gather 
frem  the  slides  that  he  showed  that  it  is  a considerably  analler 
set  of  activities  that  are  involved  than  one  encounters  in  opera- 
tional works  nowadays.  That  means  that  they  are  hopeful  for  the 
simulation  procedure  he  seems  to  have  developed,  /^jparently  he 
has  the  capabilities  in  the  simulation  of  the  branching  method 
which  decides  on  the  variables  that  have  occurred  in  the  past 
and  vAiat  branch  to  select  in  going  on  to  the  next  activity.  This 
is  how  I understood  this.  This  is  a capability  that  our  analytic 
solution  had  not  incorporated  in  the  cenputer  program.  But  it 
is  possible  to  do  so  by  working  out  the  distributions  to  reach 
a particular  intermediate  node  and  then,  dependent  on  that  dis- 
tribution in  the  decision  rule  and  then  go  in  either  one  branch 
I or  the  other.  Therefore  I believe  that  this  branching  rule 

involves  a decision  rule,  if  I understood  him  correctly,  depend- 
ing on  the  variables  that  he  has  already  encountered.  Is  it 
possible  to  incorporate  such  an  interesting  feature  in  our 
system? 

Topniller:  The  first  question  was  addressed  to  how  we  handle 
any  unique  characteristics  of  the  operators  and  how  that  may 
influence  overall  systans  perfornance.  Typically  we  do  not  use 
operational  people  as  subjects  in  our  simulations.  What  we  do  on 
the  RPV  simulation  for  exaiiple,  our  subjects  were  trained  in  that 
simulation  for  about  six  months.  So  they  became  almost  as  expert 
on  that  system  as  any  operational  people  might  be  on  their  system 
and  WE  train  them  all  to  asynptotic  levels  on  all  the  performance 
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variables  that  we  cxDnsidered  significant.  So  we  tried  to  shrink 
any  kind  of  between  subject  variance  that  may  influence  our  ex- 
perimental outcone.  That  was  our  strategy  and  it  seened  to  work 
fairly  well.  In  several  cases  we  didn't  trust  ourselves  so  we 
called  in  operational  people,  particularly  in  our  AWACS  simula- 
tion, since  the  RPV  system  is  purely  a hypothetical  system.  The 
Air  Force  does  not  have  a RPV  system.  We  build  one  for  them  in 
a simulation  context.  But  in  our  AWACS  simulation,  particularly 
our  surveillance  and  weapons  direction  simulation,  we  did  bring 


in  an  operational  group.  Typically  we  find  that  our  highly 
trained  and  naive  subjects,  when  they  start,  are  more  effective 


t 

i 


operators  overall  than  are  the  operational  people.  Now  argments 
for  the  operational  people,  that  they  have  to  unlearn  a lot  of 
their  operational  procedures  to  learn  our  hypothetical  system. 
Well,  our  v^iole  strategy  is  to  try  to  shrink  between  subject 
variance. 


The  second  question,  I believe,  is  adiressed  to  the  Saint 
modelling  technique,and  I underscore  the  term  "technique".  The 
two  corposite  features  of  it  is  the  ability  to  use  the  network 
branching  logic  vrfiich  covers  not  only  the  deterministic  type 
branching.  The  reason  we  do  this  is  tlat  for  any  operator  task 
in  a series  of  tasks  his  taking  a particular  action,  nay  be 
dependent  on  sonething  which  occurred  in  the  system  or  his  pre- 
vious operation  in  the  system.  So  when  we  go  into  an  activity 
or  node  description  we  triger  that  node  depending  on  what  has 
gone  on  previously  in  the  system  or  in  a feedback  loop.  Wfe 
have  approximately  six  different  branching  logics,  ihe  last 
part  of  your  secaid  questicxi  I was  going  to  give  a briefing  on 
SAINT.  I won't  go  into  a great  briefing  on  Saint,  because  in 
the  limited  time  I could  not  go  into  enough  detail  to  answer  your 
question  as  well  as  it  should  be.  The  other  feature  of  Saint  is 
that  we  can  handle  ip  to  11  different  distribution  types  covering 
Gaussian  through  Beta  through  a variety  of  distributions  that  we 
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feel  are  necessary  to  characterize  not  only  operator  perforTiiance 
but  also  machine  performance.  Typically,  you  find  in  nany  cura- 
tor actions  that  you  cannot  assume  the  normality  of  the  distribu- 
tion of  \4iatever  measure  you  are  taking.  More  often  than  not,  if 
you  are  dealing  with  operator  times  as  a measure,  you  find  it  can 
be  found  to  be  lognormally  distributed.  To  try  to  make  any  gen- 
eralization in  a Monte  Carlo  type  of  simulation  context,  you  have 
the  distribution  characteristics  that  fit  the  particular  activity 
that  you  are  trying  to  measure. 

Dockery:  This  question,  I guess,  is  directed  at  the  systems  panel. 

There  are  three  papers  which  I have  just  heard.  One  of  them  was 
from  the  gentleman  from  Perceptronics.  He  talked  about  the  model 
of  the  ccninander.  If  I take  his  work  and  say  that  that  was  also 
to  be  useful  to  building  a computer  model  of  the  enany  ccmmander, 
then  I think  I can  introduce  a different  dimension.  The  machine 
has  given  me  a different  dimension  that  I didn't  have  before.  If 
I take  the  one  that  vie  have  just  been  talking  about,  Hess,  I 
have  just  seen  a time-lapse  film  of  an  entire  coimand  and  control 
scheme  which  does  not  have  a lot  of  previous  analogs  which  has 
jsut  grown  up.  The  last  paper  I heard  about  TAGS AADS  and  the 
ultimate  weapon  in  ccmmand  control  is  the  ccmmittee.  All  three 

of  these  are  under  the  umbrella  of  cormand  and  control  and  I vrould  ‘ 

I 

almost  like  to  challenge  the  system  panel,  chaired  by  Dr.  Miller,  ; 

to  draw  me  the  boundary,  to  begin  to  caipartmentalize,  so  sane  j 

sort  of  structure  can  begin  to  emerge  from  the  system.  To  sum-  j 

marize,  I saw  in  three  talks  a new  dimension  of  growth  in  the 

developnent  area  and  sonething  v\hich  is  never  thought  of  in  , I 

the  caimittee,  vhich  is  clearly  out  there  working  in  the  back- 
ground. 

Bracken:  I understand  that  Mr.  Robinson  is  not  going  to  be  here 
tonorrow.  I was  hoping  that  he  would  be  because  his  interests 
are,  in  my  viev'  the  closest  of  what  I regard  the  main  problems 
that  ve  are  here  for.  He  has  discussed  a number  of  things.  To 
enlighten  General  Creech's  talk  about  how  in  his  judgment  the  Air 
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Force  was  in  roughly  the  right  balance  of  ccrinanl  and  ccntrol 
investments  and  personnel  as  ccrtpared  to  analysis  systems  and 
their  allocations.  I regard  that  as  the  major  problem  we  are 
here  to  talk  about  in  the  Army,  Air  Force  and  Navy.  What  I wourd 
like  to  ask  you  is  if  as  a principal  scientist  in  the  general 
purpose  forces  division  in  Air  Force  Studies  and  Analysis,  you 
vrere  asked  to  analyze  a trade-off  problan  involving  caimand  and 
control  system  right  now  with  existing  models,  let  us  say  trading 
off  100  F16's  against  sane  investment  in  camiand  and  control. 

Just  how  would  you  go  about  doing  that? 

Robinson:  I think  that  there  is  a lot  that  can  be  done  with  pen- 
cils and  papers  and  serious  thought.  For  instance  there  are  a 
number  of  projects  that  I am  aware  of  but  don't  want  to  get 
involved  in  that  are  starting  with  the  construction  of  time  lines 
and  whether  or  not  information  is  delivered  in  adequate  quantities 
of  the  right  kind  at  the  right  place.  I think  that  is  the  place 
to  get  started.  It  does  not  require  an  elaborate  model  to  get 
into  it  at  the  beginning.  I think  that  the  models  that  exist 
today  don't  allow  us  to  examine  any  decisions.  Wb  can  get  cer- 
tainly sane  help  in  examining  the  relative  contributions  of  F16's 
and  caimand  and  control  systans.  We  would  have  to  have  models 
of  aircraft  engagements  and  so  forth.  I am  still  going  to  tie 
this  together  with  pencil  and  paper  and  sane  hard  thought.  That 
is  vdiat  we  have  to  do  today. 

Brackan : Have  you  ever  done  this  sort  of  study? 

Robinson:  I would  imagine  that  if  we  are  working  on  the  infor- 
mation systan  that  would  be  enough.  A trade-off  of  F16's?  No, 

I have  never  done  that  one. 

Bracken:  What  do  you  think  of  possibly  having  a computer  model 
vdiich  would  simulate  both? 

Robinson:  In  a straight  sense,  I don't  think  that  we  have  any 
reasonable  prospect  for  a model  to  do  marginal  tradeoffs  of  any- 
thing, let  alone  right  now.  As  you  know,  the  techniques  that 
allow  for  optimization  are  fairly  limited  in  scope  and  allow  seme 
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appreciation  of  sane  aspects  of  the  prctoXeni,  but  they  are  so 
limited  that  we  have  to  leave  out  so  many  things.  You  look  at 
it  and  you  say  it  is  interesting  and  I have  a new  insight,  but  I 
haven't  really  solved  the  problem.  I don't  think  the  mDdel  that 
I am  talking  about  is  a model  for  trade-offs  either.  It  is  a 
model  for  learning.  We  don't  know -I  don't  think  anybody  knows - 
how  to  build  a model  to  do  trade-off  of  margins  in  a very  serious 
way  except  for  sane  certain  special  problems. 

Bracken:  So,  do  you  think  they  should  be  left  ip  to  the  judgment 
of  the  President  and  the  Secretary  of  Defense,  the  JCS,  and  the 
service  leaders? 

Robinson:  Yes,  to  provide  the  best  advice  and  insights  that  they 
can. 

Col.  Thoipson:  Let  me  give  you  one  conment  along  that  line.  What 
we  are  trying  to  do  is  figure  out  vdiat  ooimand  and  ccntrol  is. 

I noted  in  the  discussions  here  a mising  up,  if  you  will,  of  vhat 
ootmand  is.  We  speak  very  blithely  of  the  President  making  a 
decision,  and  then  we  switch  right  down  to  coipany  ooimander 
and  talk  about  his  decision  in  the  same  ocaitext.  One  thing  that 
we  (TAFIG)  are  doing  within  the  topic  right  now,  with  the  help 
of  BSD  MITRE  - it  is  a very  strenuous  effort  on  our  part  - is 
taking  apart  our  ootnnand  and  control  system  to  find  out  vhat  it 
is  that  we  do.  It  seems  rather  mundane,  but  vhen  I gather  some 
of  the  so  called  experts  in  the  CTC,  vhich  are  our  Oontrol  Sport- 
ing Center,  radar  reporting  attacks,  and  I sat  down  and  I said, 
all  right  now,  I know  what  your  job  is  in  front  on  the  scope. 

New  vho  do  yoi  talk  to  in  the  cotmand  and  ooitrol  network?  So  he 
lists  all  of  the  folks  that  he  talks  to.  And  I say,  all  right, 
now  tell  HE  vhat  you  tell  those  people?  So  he  lists  eill  the 
things  that  he  tells  those  people  and  he  also  tells  me  how  often 
he  has  to  say  it,  vhat  kind  of  informaticn  is  being  sent  back  and 
forth.  For  exaitple,  we  go  to  the  TAOC,  which  is  our  “ftictical  Air 
Oontrol  Center,  and  this  is  v^ere  all  things  are  supposed  to 


happen  in  the  tactical  world.  We  go  there  and  say,  "all  ri^t,  the 
CRC  guy  just  told  me  that  he  talks  to  you.  What  do  you  receive 
fran  the  CBC?"  So  then  he  lists  the  things  that  he  thinks  he 
receives  from  the  C3C.  Now  we  went  through  this  process  and  it 
tocSc  us  quite  a lc»ig  time  by  personal  interrogaticn  back  to  that 
expert,  whatever  that  is,  and  we  put  it  into  the  machine  and  we 
spun  it  around,  and  then  put  it  in  a matrix  to  find  out  vhat  we 
were  getting  out  of  it  and  we  found  that  there  were  2,000  errors  in 
the  questions  and  answers  we  got  of  who  talked  to  vhctn  in  the 
vrfiole  network.  People  don't  know  who  they  talk  to.  They  don't 

know  what  they  exchange.  They  are  really  not  fully  cognizant  of  i 

what  they  are  doing  at  any  given  level  - we  are  going  back  to 
functions  - very  basic  functions  - and  taking  the  system  apart  fran 
the  level.  Asking  a guy  what  he  does  in  a particular  engagement 
in  a particular  set  of  things  he  is  wjorking  in.  Then  we  start 
building  it  back  up  again.  We  are  also  going  back  to  the  con- 
mander  and  saying,  all  right  now  that  you  are  managing  this  thing 

and  you  are  matching  force  with  force,  if  any  of  you  have  the  i 

opportunity  to  listen  to  General  Dixon  talk  he  will  tell  you  a 
great  deal  about  the  big  picture  and  the  need  of  the  ccmander 
who  is  in  charge,  to  match  his  force  at  a point  where  it  wd.ll  do 
the  most  good  against  the  enany  force.  You  are  going  to  measure 
that.  Where  is  that  inpact  point?  That  is  something  that  you 
are  groi.?>ing  wdth  here.  Wfe  had  one  lecturer  talk  about  anti- 
submarine warfare.  That  is  also  coimand  and  control  with  an 
ipfutite  level  of  detail  where  young  captains,  lieutenants,  and 
sergeants  vrerk.  ihat  is  the  killirg  portion  down  there.  The  gene- 
rals are  concerned  wdth  major  force  ^plication  and  we  have  to  prtj- 

vide  them  the  advioe  on  where  to  apply  it.  Ihe  guy  down  cxi  the  ' 

Icxier  level  is  actually  killing  people  and  things.  We  are  trying 
to  help  him  kill  more  efficiently  but  wie  have  to  find  out  what  they 
do  first.  We  take  a new  systsn  and  analyze  that  and  put  it  against 
what  we  do  now.  Ma^he  we  (xi^t  to  change  some  of  the  things  we  do. 

In  some  cases  whatwe  eure  doing  before  worked  very  fine  - there  is 
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nothing  wrong  with"^te  Bell''andthe  grease  pencil  when  it  canes  to  • 

connand  and  control  in  sane  things.  In  others,  we  need  high-speed,  I 

digital  conputers  to  assimilate  a lot  of  information  because  it  i 

is  dependent  on  the  weapons  we  are  using.  The  point  was  made 
earlier  RPV  control,  ballistic  missile  defense  sane  things 
happen  that  fast.  I need  conputers  for  that.  For  others,  I 
don' t. 

Thrall:  I have  another  question  for  you.  Col.  Thaipson.  Sane 
years  have  elapsed  since  the  military  people  faced  the  problesn 
of  having  anmuniticaa  of  the  same  caliber.  It  started  anall  and 
it  has  gone  up  a little  v^ays.  I think  there  was  an  agreement  in 
NATO  about  the  size  of  cannon  ammunition  for  tanks  and  so  on. 

Now  vhen  you  shewed  us  your  picture  of  all  tte  conputers,  it 
looked  to  me  like  a real  to^er  of  Babel.  Do  you  see  any  pros- 
pect for  getting  some  of  the  things  you  were  hoping  for,  such 
as  maybe  a few  catmon  executive  routines  or  sanething?  Do  you 
think  this  is  part  of  the  problan  of  caimand  and  control? 

Ihompson:  I'd  be  naive  to  think  I could  solve  that  one.  However, 
that  worm  chart  Gen.  Dixon  uses  personally  in  a lot  of  his  brief- 
ings to  learned  people  coning  into  the  conmand  to  talk  about  a 
lot  of  these  kinds  of  problems.  Every  time  you  lock  at  that  and 
begin  to  study  it  a little  bit,  you  begin  to  think  there  is  no 
way  we  can  sort  it  out.  But  saneboefy  has  got  to  try  it.  Iteally, 
that  is  vhat  the  TAFIG  is  doing  - we  are  going  to  try.  We  are 
trying  to  get  it  into  the  conoeptual  stages.  That  is  very  iiipor- 
tant.  Ycu  mist  attack  at  the  point  vhen  sarEhc*^  has  a piece  of 
paper  and  there  is  no  cxjntract  signed  yet.  We  are  alrea<^  work- 
ing one  system  new.  We  are  just  past-source  selection,  and  we 
said,  you  are  buying  the  wrong  thir^.  They  nodded  their  heads 
and  they  understood  that  they  had  made  a mistake.  But  it  was  too 
late.  We  are  already  oermitted  to  a multimillion  dollar  program, 
and  they  can't  stop  it.  Now  we  are  worryirvg  about  patching  it. 

Weeh:  What  is  your  feeling  as  to  why  these  eperators  don't  quite 
jive  in  their  assesanent  of  what  they  are  doing?  It  would  appeeir 
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to  me  that  that  in  part  a lack  of  training.  If  they  do  it 
every  day,  there  nhould  be  loss  difference.  My  question  concerns 
the  need  for  in-house  training  programs  to  seek  out  these  trailers 
in  the  field. 

Thompson:  This  is  probably  one  of  the  most  critical  things  we 
are  facing.  In  TAC,  our  job  is,  of  course,  training.  The  answer 
is  no,  we  have  not  done  anything.  The  reason  is  that  ccmand  and 
control  is  just  on  the  verge  of  caning  of  age,  if  you  will.  In 
comiand  and  control  five  years  ago,  automation  was  nonexistent. 

We  worked  with  grease  pencils  and  telephones.  The  typical  thing 
was  to  get  a phone  call  and  a guy  asked  for  resources.  Then  you 

find  them  and  send  than  to  him.  That  is  essentially  what  we  did.  ^ 

When  vre  had  enough  folks,  banbs  and  airplanes  to  do  the  job,  that  j 

was  satisfactory.  But  we  are  in  the  position  of  having  a minority  ) 

i 

viewpoint  new.  We  are  outmanned,  outgunned  and  outnumbered,  so  | 

we  had  better  learn  to  apply  things  where  we  want  to,  where  we 
think  it  wall  do  the  most  good.  This  neans  ve  develop  sophisti- 
cated catmand  and  control  systems  to  sense  where  the  enemy  really 
is,  where  his  softest  spot  is,  and  go  after  it.  But  I have  not 
found  a cermand  and  control  AFSC.  I think  probably  the  Navy  is 
the  lead  service  in  developing  catmand  and  control  people.  Even 
they  are  having  trouble  retaining  the  people.  It  is  very  unglam- 
orous  work.  They  stick  a guy  back  in  sane  dark  roan  soneplace  in 
the  middle  of  the  ship.  All  he  sees  all  the  time  is  sane  idiot 
display.  He  keeps  punching  buttons  and  talking  to  guys.  He  has 
no  sense  of  satisfaction  in  the  whole  thing.  In  the  Air  Force 
and  the  Army,  we  are  doing  the  same  thing.  They  tend  to  cone 
into  it  and  get  out  of  it.  There  is  no  glamor.  It's  sheer 
suicide  as  far  as  your  career  goes,  because  the  minute  you  start 
doing  this  thing  very  long,  you  lose  visibility.  So  people  get 
out  of  the  field  right  away.  As  I said,  I think  the  Navy  is 
very  far  ahead  of  us  in  this.  They  have  sane  very  good  training 
mechanisms  at  Norfolk  and  San  Diego.  They  do,  I thinJc,  a nice 
job  as  that  sort  of  thing  goes. 
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Richard  Pew:  This  questicxi  may  be  a bit  naive.  Isn't  it  possible 
to  think  about  the  problem  the  other  way  around?  Not  so  much  as 
building  the  system  so  they  can  interface  prc^rly  but  rather 
thinking  about  designing  a device  which  I would  say  is  analogous 
to  the  inp  in  the  ARPA  coTipuber  network  vhich  matches  one  host 
computer  to  another.  I knew  there  is  effort  to  try  to  make  it 
possible  to  access  a data  file  in  another  conputer  anl  make  that 
process  transparent  to  the  user  in  another  location.  That  gen- 
eral oonc^t  might  be  applied  to  your  worm  chart. 

Thenpson;  Yes,  we  are  working  on  that  kind  of  thing,  \diere  it 

can  apply.  You  have  to  recognize  that  cermand  and  control  systems 
sort  of  thing  vrfiere  they  have  access  to  a file.  A canmand  and  con- 
trol system,  as  I think  of  it,  is  a demand  response  system.  I tell 
you  something,  I expect  a reply  back.  I give  you  a certain  question 
or  I give  you  a certain  cemnand  that  calls  for  a reaction,  a demand 
or  respcxise  bade  to  me  in  another  ncmenclature.  I say  "Engage” 
and  you  tell  me  how  you  are  doing  it  and  when.  Or  you  tell  me 
you  are  covering  it,  for  example.  That  is  our  problem.  Our  sys- 
tems work  cn  the  logic  to  sipport  that.  When  I get  a buffer  in 
here  - like  you  maiticxied  in  the  ARPA  network  - I have  to  build 
an  entire  system  on  both  sides  of  the  buffer  so  it  understands. 

We  are  in  a very  serious  problem  in  Europe  now.  It  was  men- 
tioned ecurlier  that  we  were  building  a 407L  mobil  TAGS  into 
Europe.  It  seemed  simple  enough  - we  were  going  to  exchange 
radar  data.  Unfortunately,  the  Europeans  use  a different  track 
nttrbering  system  than  we  do.  Ihe  very  translation  of  track 
noifcering  is  a ccupletely  different  logic.  It  became  a very 
difficult  task,  softwarewise,  to  build  a translator  in  there. 

We  had  to  modify  our  system  to  acoatplish  this. 

Modridc;  I think  you  were  talking  about  a very  important  point 
on  that  diagram.  It  is  showing  ociimand  cntmunication  links,  but 
not  really  showing  the  base  level  of  information  processes  that 
svpport  that.  Would  you  not  also  have  a large  input  of  infoma- 
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tion  requirements  into  each  one  of  these  sources  or  buffers  in 
order  to  support  the  decision  and  ccnmand  and  control  that  are 
being  ccrinunicated  over  the  links  you  just  shewed  there? 

Thdnpson:  It  is  quite  true,  we  do.  In  other  words,  almost  every 
one  of  those  lines  is  actually  three  or  four  or,  in  some  cases, 
eight  actual  links  with  information  flowing  in  of  varying  types. 
It  is  very  true,  and  I have  further  breakouts,  but  that  gets 
into  the  classified  aurea  of  what  is  on  those  links,  and,  specifi- 
cally, the  rates  vie  are  exchanging  at,  what  information  is  in  it. 
It  is  far  more  complex  than  shown. 

Col.  Pride:  I don't  know  if  I have  a question.  If  I have  a 
;i  question,  I don't  know  who  I want  to  ask  it  of.  Maybe  I just 

! ' want  to  voice  a wail  of  frustration  because  until  four  months 

! i ago  I was  the  cctimander  of  the  ccitinand  and  control  system  in 

I 

Europe.  All  those  lines  belonged  to  me.  Every  one  of  those 
lines  represents  the  third  C,  the  C that  comes  after  contnand  and 
control,  and  that's  canmunication.  In  our  attack  on  the  solution 
of  problems,  we  sometimes  assume  away  that  portion  that  we  recog- 
‘ nize  that  we  can't  solve.  What  I'd  like  to  know  -and  here's 

! where  I don't  knew  whom  to  ask  -is,  were  I still  the  coimander, 

' who  are  you  and  what  are  you  doing  to  give  me  some  reliable  and 

survivable  cctnmunications,  so  that  my  coimand  and  control  system, 

1 whatever  it  is,  is  going  to  work  five  minutes  after  the  first 

bombs  drop? 

Thempson:  I'll  duck  that. 
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A SUMMARY  DESCRIPTION  OF  THE 
VBCrOR-2  THEATER  LEVEL  CAMPAIGN  MODEL 

by  SETH  BONDER 

\J&cXo>i  RMCoAcfi,  lncofipo>Latzd 


I.  Inf ic’ducf u’ti.  Based  in  part  on  its  work  in  modeling  small 
unit  combat  activities,  the  Weapon  Systems  Evaluation  Group  (WSBG) 
in.  tiatcxJ  a program  with  VRI  in  the  fall  of  1972  to  develop  thea- 
ter level  cainjai^.i  models  that  did  not  involve  the  use  of  "fire- 
power score"  concepts.  A prototype  model,  VBCTOR-0,  was  completed 
in  August  1973  to  danonstrate  the  feasibility  of  modeling  this 
level  of  activity  without  the  use  of  firepcver  scores.  The  first 
production  version,  VECTOR-1,  was  completed  in  September  1974, 
and  its  preprocessor  (vihich  oorputes  seme  of  the  VBCTOR-l  inputs 
from  more  basic  weapons  data  and  ties  directly  into  the  NITFAM-3 
data  base  to  directly  use  its  order-of -battle  data)  was  cotpleted 
in  January  1975.  The  VECIOR-l  model  is  currently  operating  on  a 
ntmber  of  govemme;  t coiputers  including  the  HIS  6080  of  the 
Cenmand  and  Control  Technical  Center^,  for  which  extensive  docu- 
mentation was  prepared.  A sector  of  the  VECTOR-l  model  was  ex- 
tracted and  enriched  for  use  as  a Divisicai  Level  Model  (DIVOPS) 
in  a nimber  of  Army  studies  including  the  Army  Requirements  for 
Air  rorce  Close  Air  Support  and  the  RQIBASS  Cost  and  Operational 
Effectiveness  Analysis. 

VECTOR-2  is  the  second  in  the  s-  "ies  of  production  model 
developments  to  simulate  two  sided  theater  level  mid- intensity 
canpaijns  involving  both  ground  and  air  forces  and  systems  dyna- 
mically Literacting  on  both  sides.  Specifically,  we  were  asked 
to  add  first  order  effects  of  cotmard  and  ccxitrol,  cemnuni cations, 
and  intelligence  to  the  first  version,  VBCTOR-l,  which  already 
had  the  first  order  effects  of  many  of  the  cortoat  processes  than- 

^Corputer  facility  that  supports  the  Joint  Chiefs  of  Staff. 
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selves.  As  you  will  see  in  a itcment,  in  order  to  incorporate  the 
conmand  and  control,  intelligence  and  caimunicaticyi  processes, 
VBCrOR-2  turned  out  to  be  a totally  new  structure  (as  carpared  to 
VECrOR-1)  in  the  manner  in  vhich  we  had  to  consider  the  battle- 
field geonetry,  forced  enploymsnts  and  locations,  the  ccmnand 
hierarchy,  and  the  timing  of  the  various  cctnbat  and  catibat  related 
process  events. 

Before  describing  sane  of  the  itodel  ccaitent,  I should  hasten 
to  add  that  the  nodel  still  does  not  include  explicitly  a number 
of  relevant  phencmena,  including  non- integral  feedback  situations^, 
tactical  nuclear  warfare,  and  explicit  representaticai  of  electro- 
nic warfare  (although  elements  of  this  can  be  inplicitly  played) . 

It  does  not  include  sane  elements  of  connand  and  control  specified 
by  General  Vfelch  and  Mr.  Robinson  at  this  conference,  but  vhich 
are  to  be  included  in  the  eventual  development  of  the  Ccmbined 
Arms  Simulation  Model  (CASM) . 

Although  VBCrOR-2  has  not  been  exercised  in  a full  theater 
level  100-day  canpaign,  it  is  clear  fron  our  analyses  and  studies 
with  previous  versions  of  the  VBCTOR-series  models  and  parts  of 
them  (i.e. , DIVOPS)  that  tactical  decision  behavior  (i.e.,  tac- 
tics) have  a significant  effect  on  the  canpaign  results. 

2.0  Concept  oj)  Vector.  The  overall  concept  on  vhich  VEX2rOR-2  is 
based  is  illustrated  in  exhibit  1.  A coimander  at  any  level  of 
the  theater  cormand  hierarchy  has  available  as  input  to  his  deci- 
sion-making process  a desired  state  of  the  world  (often  stated 
explicitly  in  terms  of  a mission  vhich  he  is  to  acccrplish)  and  a 
perceived  state  of  the  world  (which  includes  his  perception  of 
friendly  and  enany  force  strengths  and  deployments  and  his  per- 
ception of  the  area  of  operations  in  v^ch  these  forces  are 
deployed) . Given  this  information,  the  cotmander  makes  decisions 

^Those  situations  vMch  involve  intermingled  Blue  and  Red  forces 
such  as  deep  penetraticns  and  exploitations,  sieges,  air  drops, 
flank  combats,  etc. 
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which  are  designed  to  attenpt  to  change  the?  perceived  state  of 
the  world  in  such  a way  that  it  nutclies  the  desired  state  of  the 
vorld.  These  decisions  involve  the  assigrment  of  subnissions  to 
Icwer-echelon  units  and  the  allocation  of  resources  to  accerplish 
these  subnissions.  Such  decisions  are  transmitted  by  a ccmiuni- 
cations  process  (resulting  in  a possible  time  lag)  and  eventually 
are  carried  out  in  such  a way  as  to  affect  canbat  and  related  pro- 
cesses. These  processes  (and  an  analogous  set  of  processes  on  the 
enemy  side)  affect  the  actual  state  of  tine  world  by  changing  force 
levels  and  deploynents  for  both  Red  and  Blue.  Information  con- 
cerning tlie  resulting  new  state  of  the  world  is  transmitted  by 
means  of  ccrmunications  processes  and  (for  sore  of  the  information) 
intelligence  processes,  resulting  in  the  coiitiander  revising  his 
perception  of  the  current  state  of  the  world.  Note  that  at  a 
given  point  in  time,  this  perceived  state  of  the  world  may  differ 
frem  the  actual  state  of  the  world  as  a result  of  decision  lags, 
ccrmunications  lags,  and  inperfect  intelligence.  The  cemmander 
then  may  ma)ce  new  decisiens  in  a further  attaipt  to  match  the 
desired  and  perceived  states  of  the  world.  This  feedbacl<  control 
system  operates  continuously  at  all  levels  of  tlie  cemand  hier- 
archy. 

In  VBCTOR-2,  the  perceived,  desired,  and  actual  states  of 
the  world  are  all  represented  by  sets  of  variables  Icnown  as  "state 
variables".  These  variables  describe  all  aspects  of  the  state  or 
status  of  the  engagement  at  any  time  during  a run  of  the  model, 
including  the  cemrarders'  perceptions  of  the  a..tual  status  and 
their  desired  statuses.  Initial  values  of  these  state  variables 
descriite  the  battlefield  prior  to  the  initiation  of  canbat  The 
state  variables  are  ipdated  as  the  canbat  progresses  by  a set  of 
process  models,  which  describe  the  processes  of  tactical  decisions, 
coimunications,  canbat,  intelligence,  etc.  VE)CrOR-2's  state  vari- 
ables ^u:e  described  in  section  2 . 1 of  this  paper;  its  process 
models  sure  suvmarized  in  section  2.2. 
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?■  / RepicAcatafU'ii  o,^  StatiueA  in  VECTOR-2.  The  following  sub- 
sections describe  the  way  in  which  VBCTOR-2,  through  the  use  of 
state  V£iriables,  represents  the  status  of  the  caiipaign  at  any  time 
during  a run  of  the  model. 

I Folc&i.  VECTOR-2  considers  Red  and  BIik  maneuver  forces, 

field  artillery  forces,  air  defense  artillery  forces,  tactical 
fixed-wing  air  forces,  and  attack  helicopters.  Maneuver  forces  on 
each  side  can  contain  up  to  11  weapons^  plus  personnel  and  can 
enploy  minefields.  Typically,  maneuver-unit  weapons  are  repre- 
sented by  two  armor  (tank)  systems,  tliree  antitank  systems,  an 
attack  helicopter  systan,  infantry  with  rifles,  infantry  with 
heavy  automatic  weapons,  infantry  with  area  fire  weapons,  and  two 

air  defense  artillery  systans.  Field  artillery  forces  can  contain 
2 

up  to  five  weapon  system  types  and  associated  personnel.  Air 
defense  artillery  forces  can  c»ntain  up  to  six  types  of  weapon 
systans  and  associated  perscxinel.  The  tactical  air  forces  are 
coiprised  of  up  to  seven  types  of  fixed-wing  aircraft  and  assoc- 
iated personnel.  Aircraft  at  airbases  may  be  sheltered  or  un- 
sheltered; each  side  may  have  up  to  two  specific  types  of  aircraft 
shelters  (each  of  wiiich  is  dedicated  to  a single  aircraft  type) 
and  one  general-purpose  type  of  shelter  (wtiich  can  house  any  type 
of  aircraft) . Attack  (lelicopters  and  associated  personnel  are 
available  as  a fire  support  resource  as  well  as  being  utilized  as 
one  of  the  naneuver-unit  weapons.  The  model  continually  keeps 
track  of  the  current  inventories  of  personnel  and  weapon  systans 
by  type  and  location.  It  also  keeps  track  of  the  caimand  hier- 

^A  "dimension  changer"  is  currently  being  designed  that  will 
facilitate  autonatic  changes  in  dimension  limits  (e.g. , increased 
types  of  field  ari tilery,  reduction  in  nunter  of  sectors  used  in 
a study,  etc.).  Dimension  limits  noted  in  tliis  paper  are  those 
that  have  been  used  in  the  development  process. 

2 

‘A  mortar  is  currently  represented  as  one  of  the  FA  weapon  system 
types. 
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archy  of  maneuver  forces  fron  theater  dcwn  to  battalion  level. 

In  addition  to  the  above  ccmbat  elanents,  VECTOR-2  repre- 
sents 14  classes  of  observation  resources  along  with  their  assoc- 
iated personnel  for  collecting  target  and  enat^  order-of -battle 
intellj -lence . Command  posts  and  associated  personnel  are  also 
represented. 

2 . ) . 2 SupptLiHi . Supplies  of  the  follcwing  kinds  are  separately 
represented  in  the  model:  amnuniticn  for  each  army  gro'jnd  weapon 
systan  type,  lard  mines,  ordnance  (in  up  to  elevcrn  user-specified 
categories  for  each  side^)  for  aircraft,  (including  attack  heli- 
copters) , aviation  gasoline  and  associated  POL  (for  fixed-wing 
aircraft  and  attack  helicopters) , pOL  for  ground  systems,  and  a 
single  category  of  other  supplies. 

2,1.3  BaJXteftLcZd  GtomuXnij.  VEcrOR-2  considers  the  battlefield 
to  be  divided  into  up  to  seven  sectors  running  through  both  Blue 
and  Red  territory  (see  exhibit  2) . Red  territory  is  assimed  to  be 
divided  frctn  Blue  by  tvro  lines  within  each  sector.  These  Red-Blue 
dividing  lines  are  referred  to  individually  and  collectively  as 
the  FEBA.  The  FEBA  on  each  side  marks  the  forward  edge  of  front- 
line forces  on  that  side. 

Each  sector  can  be  divided  into  areas  which  are  called  ccm- 
bat  arenas  (see  exhibit  3).  Within  limits,  the  widths  of  arenas 
can  vary,  but  the  width  should  be  sufficient  to  conduct  an  inde- 
pendent defense  (approximately  battalion  size) . Each  sector  nay 
contain  up  to  15  arena  "ribbons"  or  corridors.  Natural  or  man- 
made defensive  features  (e.g.,  ri\7ers,  mountains,  cities,  or 
crossroads)  or  other  designated  objectives  constitute  the  end 
boundaries  of  the  arenas  within  a corridor.  Specifically,  any 
feature  v^ich,  if  defended,  requires  a particular  task  force 
organization  to  be  defeated  can  be  an  arena  botjndary.  These 
boundaries  constitute  possible  objectives  for  Red  and  Blue.  An 

^ These  may  be  configured  into  to  ten  ordnance  loads  on  each 
side. 
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EXHIBIT  3:  BATTLEFIELD  GEO.'IETRY  --  COMSAT  AREtlAS 


arena  nay  possess  between  its  boundaries  defensible  positions. 
Defensible  positions  are  those  locations  at  vitiich  a force  would 
halt  and  defend  requiring  an  advancing  force  to  assault  the  posi- 
tion. Defensible  positions  arc  uniformly  distributed  between  the 
arena's  boundaries;  that  is,  if  an  arena  is  20  kilometers  in  depth 
and  has  four  defensible  positions,  they  will  be  separated  frem  the 
boundaries  and  frem  each  other  by  four-kilometer  intervals.  As  a 
minimum,  the  sep^lrati(al  distances  must  be  greater  than  the  range 
of  a maneuver  unit's  direct  fire  veapons.^  Red  and  Blue  maneuver 
forces  of  varying  sizes  and  cerpositions  may  be  deployed  within 
an  arena. 

For  the  purpose  of  locating  forces  in  the  rear  area,  the 
battlefield  is  divided  into  zcaies  (see  exhibit  4) . Unlike  arenas, 
zones  "float"  with  the  FEBA,  maintaining  their  orientation  with 
respect  to  the  FEBA  rather  them  with  respect  to  the  terrain  of  the 
battlefield.  At  the  FEBA,  the  lateral  boundaries  of  zones  coin- 
cide with  the  boundaries  of  arena  corridors.  Blue  and  Red  zones 
exist  independently;  they  need  not  "line  up"  with  each  otlxjr.  The 
user  may  define  up  to  three  levels  of  zones,  each  level  located 
in  a band  in  successive  depth  frem  the  FEBA.  (The  first  level 
might  correspond,  for  example,  to  front-line  divisions,  the  second 
to  the  corps  rear,  etc.). 

2.1.4  lotcc  VeptoifmciitA  and  Suppl'i/  hiveiitorieA . The  forces  and 
supply  types  discussed  earlier  are  deployed  on  the  battlefield  in 
physical  grotpings  referred  to  as  resource  groups.  Each  groip 
consists  of  the  app  ooriate  force  elements  as  well  as  associated 
personnel  and  stpplies.  Some  resource  groups  are  located  in  depth 
from  the  FEBA  within  zones  of  the  battlefield  while  others  are 
located  in  terms  of  a two-dimensional  coordinate  system.  Those 
groups  located  at  specific  depths  frem  the  FEBA  within  zones  are: 

■^is  is  to  prevent  a direct-fire  engagement  frem  occurring  while 
opposing  forces  are  both  on  defensible  positicxis. 
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(1) 

field  artillery  batteries; 

(2) 

air  defense  sites: 

(3) 

helicopter  bases; 

(4) 

groups  of  observation  resources; 

(5) 

supply  depots; 

(6) 

airbases; 

(7) 

a "miscellaneous"  category  for  representing  groups  of 
replacements,  arrivals  to  a sector,  repair  facilities 
supplies  in  transport,  etc. 

Resource  groups  located  in  a coordinate  systan  include: 


(1)  reserve  and  front-line  maneuver  units  (of  different 
conmand  levels) ; and 

(2)  airborne  flights  of  aircraft. 

2 . ? . 5 T u)ie . Mcxlel  time  in  'yiCTOR-2  is  essentially  continuous  and 
allows  for  maintaining  simultaneous  statuses  of  all  elements  in  a 
ccmbat  sector.  This  is  acocmfjlishod  by  the  use  of  multiple  cloc)cs^ 
and  a combination  of  event  and  time  step  simulation  techniques. 
Certain  activities  (sector  replacements,  theater  arrivals,  etc.) 
are  restricted  to  occur  only  at  the  beginning  of  "model  time 
periods",  which  are  assumed  to  correspond  to  real  time  intervals 
of  approximately  a day. 

2.1.6  Battle fiieJLd  Ewi'ioiimeiit.  The  effects  of  terrain,  terrain 
features  and  weather  conditions  are  represented  in  VBCroR-2.  Ter- 
rain is  classified  independently  with  respect  to  six  levels  of 
terrain  intervisibility  (line  of  sight)  and  six  levels  of  traffi- 
cability.  Thus,  36  types  of  terrain  can  be  represented  in  the 
model.  Terrain  is  assumed  to  be  horogeneous  within  a ccmbat  arena, 
but  may  vary  from  arena  to  arena.  In  addition,  a variety  of  ter- 
rain features  are  represented  in  the  model.  These  features  include 

^The  cloclc  time  steps  can  be  set  by  the  user.  The  model  is  cur- 
rently operating  with  30  second,  three  minute,  fifteen  minute, 
one  hoar,  and  six  hour  cloc]cs,  in  addition  to  the  "model  time 
period"  of  a day. 
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urban  areas,  rivers,  and  an  unidentified  terrain  feature  that  can 
be  specified  by  the  user  of  the  model.  All  terrain  features  are 
located  at  the  end  boundaries  of  cento t arenas. 

Weather  conditions  in  each  sector  of  the  battlefield  can  be 
input  to  the  model  for  every  hour  of  simulated  campaign.  Weather 
is  represented  in  terms  of  four  levels  of  each  of  the  following 
characteristics : 

(1)  weather  visibility  for  ground-to-ground  operations; 

(2)  weather  visibility  for  ground-to-air  and  air-to-ground 
operatiems; 

(3)  weather  visibility  for  air-to-air  operations; 

(4)  weather  trafficability  for  ground  operations  (used  to 
represent  the  effects  of  adverse  weather  conditions 
such  as  rain  or  snow  on  terrain  trafficability) ; and 

(5)  weather  trafficability  for  air  operations  (used  to 
represent  the  effects  of  wind  speed  and  direction  on 
air  operations) . 

To  determine  the  effects  of  precipitation  on  movanent  of  vehicles, 
it  is  necessary  to  knew  the  type  of  terrain  over  which  irovement  is 
being  conducted.  Rain  may  interact  wdth  most  types  of  terrain  to 
produce  mud  which  impedes  movanent,  but  rain  interacting  with  sane 
terrain  types  may  have  a positive  effect  on  mobility.^  To  reflect 
this  conbined  effect  of  weather  and  terrain  on  ground  traffica- 
bility, an  envirortnental  trafficability  index  is  determined  within 
the  model  as  a function  of  the  current  weather  trafficability 
index  for  ground  movanent  and  the  terrain  trafficability  index. 

Six  levels  of  envirortnental  trafficability  are  represented.  Simi- 
larly, an  environmental  visibility  index  is  canputed  within  the 
model  as  a function  of  the  current  weather  visibility  index  for 
ground-to-ground  operations  and  the  terrain  visibility  index.  Six 
levels  of  environmental  visibility  are  available  and  are  used  by 
the  model  when  the  conbined  effects  of  terrain  line  of  sight  and 

^Movement  over  desert  terrain  may  be  aided  by  infrequent  precipi- 
tation which  packs  the  sand. 
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weather  on  ground  visibility  are  needed. 

2.1.7  Uiii-iom  and  Activ-it(e.i.  Maneuver  forces  in  VKCTOR-2  are 
assigned  missions  and  carry  these  missions  out  as  activities.  At 
the  sector  level,  missions  are  assigned  fron  the  following  list:^ 

(1)  advance; 

(2)  hold; 

(3)  hold,  delay  if  attacked; 

(4)  hold,  withdraw  if  attacked;  and 

(5)  withdraw. 

Subordinate  maneuver  units  within  a sector  (at  any  level  dcwn  to 
front-line  battalicm  task  forces)  are  assigned  missions  fron  the 
following  list:^ 

(1)  advance; 

(2)  hold; 

(3)  hold  and  delay  if  attacked; 

(4)  hold  and  withdraw  if  attacked;  and 

(5)  withdraw  to  a fixed  location. 

In  carrying  out  their  missions,  front-line  units  engage  in  various 
fire  and  maneuver  activities.  They  may  move  forward  or  backward 
within  the  conbat  arena  in  which  they  are  cperating,  and  they  may 
engage  in  conbat  at  a defensible  position,  coitoat  between  defen- 
sible positions  (while  the  defender  is  moving  to  the  next  position 
to  the  rear) , conbat  at  a river,  conbat  in  an  urban  area,  or  con- 
bat  at  a user-defined  terrain  feature.  SiK:h  conbat  might  be  of 
the  nature  of  an  assault  against  a defender,  or  might  be  associ- 
ated wdth  an  advance  against  a delaying  action  or  a pursuit 
against  a withdrawal. 

^ These  mission  statements  can  (and  it  is  expected  will)  be  ex- 
panded to  include  nore  specific  time  and  terrain  objectives,  i.e., 
"Hold  yova:  current  position  for  ten  hours,  however  if  attacked, 
sielay  the  enemy  force  for  two  hours  while  moving  back  to  the  next 
defensible  position". 
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Fixed-wing  tactical  aircraft  may  be  assigned  the  missions  of 
combat  air  support,  escort,  intercept,  or  interdiction.  Aircraft 
assigned  to  the  interdiction  mission  are  allocated  to  engage 
acquired  targets,  including  ccmitted  reserve  units,  unconmitted 
reserve  units,  ccnrand  posts,  airbases,  si^ly  depots,  field 
artillery  batteries,  air  defense  sites,  or  carget  acquisition 
resources.  In  carrying  out  these  missions,  the  aircraft  nay 
beccme  involved  in  air-to-air  ccmbat. 

Attack  helicopters  may  be  assigned  a fire  support  role  or 
may  participate  as  a maneuver-unit  weapon  in  froat-line  ccmbat. 
Those  helicopters  performing  fire  support  missions  can  be  assigned 
to  attack  maneuver-unit  elements,  cannitted  or  unccrmitted  reserve 
units,  ccmmand  posts,  airbases,  depots,  target  acquisition  re- 
sources, field  artillery  batteries  or  air  defense  sites.  Those 
participating  in  a maneuver  unit  engagement  perform  the  same  act- 
ivities as  the  maneuver  unit  vtiich  they  are  supporting. 

Field  artillery  weapons  may  conduct  pre-engagatient  fires 
(including  preparatory  fire  and  counter-preparatory  fire)  against 
maneuver  units,  opposing  field  artillery,  and  air  defense  artil- 
lery. They  participate  in  final  protective  fires  against 
attacking  maneuver  units, ^ and  may  conduct  disengagement  fires 
against  front-line  maneuver  units.  They  may  also  be  allocated  to 
fire  at  acquired  targets,  including  front-line  maneuver  units, 
comdtted  reserve  units,  unccrmitted  reserve  units,  ccrmand  posts, 
depots,  target  acquisition  resources,  artillery  batteries,  air 
defense  sites,  or  airbases. 

Air  defense  artillery  may  engage  attack  helicopters  and 
fixed-wing  aircraft  vtiich  are  en  route  to  or  frcm  ground  targets 
or  which  are  attacking  the  air  defense  sites  or  targets  near  the 
sites. 


Mortars  and  machine  guns  also  participate  in  final  protective 
fires. 
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2, 1.S  I nteltiq mzz . The  connander's  perception  of  tte  enemy  and 
the  area  of  operations  is  represented  in  VEClOR-2  by  a set  of 
state  variables  describing  the  current  status  of  knowledge  about 
the  terrain,  future  weather  conditions,  potential  targets,  and  the 
enemy's  order  of  battle.  Weather  intelligence  is  in  the  form  of 
five-day  forecasts  by  both  Red  and  Blue  of  future  weather  traffi- 
cability  ard  visibility  indices.  Target  intelligence  acquires 
targets,  against  which  fire  support  may  be  allocated.  Kinds  of 
targets  which  may  be  acquired  include  front-line  maneuver  units, 
field  artillery  batteries,  air  defense  artillery  sites,  ccrmand 
posts,  logistical  targets,  unccmitted  naneuver  unit  reserves, 
ccnmitted  maneuver  unit  reserves  in  transit,  penetrating  aircraft 
groups,  aircraft  and  helicopter  bases,  and  target  acquisition 
resources.  Order-of-battle  intelligence  consists  of  current  esti- 
mates of  the  strengths  of  enemy  ma.neuver  units  by  coordinates 
(both  front  line  and  reserve) , and  numbers  of  other  resource  groups 
by  zone. 

2,2  RipAtue-fitcLtcon  PAoccAiu  in  I/ECTOR-2.  Six  types  of  pro- 
cesses modeled  in  VECrOR-2  cause  dynamic  change  in  values  of  the 
state  variables.  These  types  are  as  follows: 

(1)  Firepower  processes  are  processes  in  \4iich  the  fire- 
pcwer  of  one  of  the  opposing  sides  causes  damage  to 
elements  or  supplies  of  the  other  side. 

(2)  Ccrmand  and  control  processes  include  the  processes  of 
cotimand  decision  making  in  response  to  situations  on 
the  battlefield. 

(3)  Intelligence  and  target  acquisition  proc  esses  collect 
information  about  terrain,  future  weather  conditions, 
potential  targets,  and  the  enemy  order  of  battle  for 
use  in  fire  support  allocation  and  ccritand  and  control 
processes. 

(4)  Conmunications  processes  relay  information  between 
intelligence,  ccnmand,  and  ccmbat  elements  on  the 
battlefield  and  include  the  time  delays  inherent  in 
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such  information  transmission. 

(5)  Logistics  processes  include  the  consurption  of  supply 
items  by  force  elements  in  VBCTOR-2,  and  the  resupply 
of  '■reapons,  personnel,  and  supplies  to  conbat  units. 

(6)  Movement  processes  include  the  movement  of  forces  on 
the  battlefield  as  part  of  the  gaining  or  losing  of 
ground  by  front-line  forces,  the  commitment  of  reserves, 
the  retirement  of  front-line  units,  and  the  movement 

of  air  flights  during  missions. 

The  following  sections  describe  these  processes  and  list  their 
outputs. 

2.2.1  Fi.’ie.pouieA  Pfiocc66eA.  VEx;7rOR-2's  firepower  process  models 
describe  different  mechanisns  of  delivering  firepower  and  the 
effects  of  these  firepower  processes  on  force  composition  values, 
supply  levels,  and  the  inventories  of  other  targets.  The  specific 
firepower  processes  represented  in  VBCrOR-2  can  be  grouped  into 
four  general  categories: 

(1)  Ground-to-ground  firepower  processes  include  maneuver 
unit  activities  such  as  an  assault  against  a hasty 
defense,  an  advance  against  a delay,  a pursuit  against 
a withdrawal,  a river  crossing,  or  urban  warfare;  also 
included  are  field  artillery  effects  against  front-line 
maneuver  units,  reserves,  air  defense  artillery,  field 
artillery,  etc. ; and  the  effects  of  minefields  against 
maneuver  units. 

(2)  Air-to-ground  firepower  processes  include  attack  heli- 
copters and  fixed-wing  aircraft  attacks  on  maneuver 
units  and  other  targets  such  as  cortmand  posts,  supply 
d^x3ts,  reserves,  airbases,  attack  helicopter  bases, 
field  artillery,  air  defense  artillery,  etc. 

(3)  Ground-to-air  firepower  processes  consist  of  the 
effects  of  air  defense  aurtillery  on  attack  helicopters 
and  fixed-wing  aircraft  attacking  ground  targets. 
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(4)  Air-to-air  firepower  processes  include  the  interactions 
of  interceptors  versus  escorts  and  interceptors  versus 
attacking  aircraft. 

In  constructing  models  of  these  processes,  the  relationship 
of  fires  at  a target  and  fires  by  that  target  has  required  the 
constructicji  of  "duel"  znodels  or  sets  of  many  of  these  processes, 
included  among  these  models  are  models  of  the  effects  of  the 
fires  of  opposing  maneuver  units  on  each  other;  models  of  the 
effects  of  counterbattery  fire;  models  of  the  effects  of  the  fires 
of  interceptor  and  escort  aircraft  and  of  interceptor  ar«d  attack 
aircraft  on  one  another;  models  of  the  effects  of  attack  helicop- 
ter fires  on  maneuver  units  and  of  the  fires  by  maneuver  units 
and  associated  air  defense  weapons  on  attack  helicopters;  and 
models  of  the  effects  of  the  fires  of  attack  aircraft  flying  air 
defense  suppression  missions  on  their  targets  and  the  fires  of 
these  air  defense  weapons  on  the  attacking  aircraft. 

In  all  these  areas,  whether  a duel  model  is  involved  or  not, 
the  models  used  in  VBCTOR-2  have  been  built  frcm  detailed  models 
of  the  firing  behavior  and  physical  damage  processes  involved. 

In  some  cases,  these  detailed  models  are  thanselves  used  in 
VECIOR-2  and  in  others,  VBCrOR-2  uses  a suirmary  model  for  vAiich 
data  can  be  generated  frcm  the  available  detailed  models  of  the 
process.  Thus,  inputs  to  each  of  these  models  are  either  direct- 
ly measurable  quantities  or  can  be  estimated  frcm  systems  engi- 
neering models  or  more  detailed  ccmbat  process  models. 

The  air-to-air  firepower  process  model  describes  the 
interactions  of  the  duel  involving  attack  aircraft  and  their 
escorts  versus  opposing  interceptors.  Outputs  of  this  submodel 
include  the  number  of  surviving  aircraft,  by  type  and  the  number 
of  aircraft  aborting  their  mission,  by  type. 

The  ground-to-air  firepower  process  models  describe  the 
interactions  of  air  defense  artillery  against  fixed-wing  aircraft 
and  attack  helicopters  flying  missions  to  attack  ground  targets 
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(as  a function  of  aircraft  type  and  flight  path),^  and  the  effects 
of  ground  maneuver  forces  and  associated  air  defence  weapons  enga- 
ging attack  helicopters.  The  first  of  these  process  models  con- 
siders the  effects  on  the  aircraft  during  the  flight  bo  its  target 
while  in  its  target’s  area,  and  during  the  return  flight.  Models 
of  maneuver  force  engaganents  generate  the  number  of  attack  heli- 
copters attrited,  when  helicopters  are  involved  in  such  engage- 
ments. 

The  air-to-ground  firepcxer  process  models  separately 
describe  the  effects  of  aircraft  or  attack  helicopters  against 
maneuver  units  at  the  FEBA  and  aircraft  or  attack  helicopters 
against  other  targets  such  as  reserves,  supplies,  sheltered  and 
unsheltered  aircraft  at  airbases,  etc.  The  models  describing 
the  firepcwer  processes  against  maneuver  forces  at  the  FEEA  gene- 
rate surviving  numbers  of  weapon  systems  (by  type)  in  the  maneuver 
force,  while  the  models  describing  firepower  effects  against 
other  ground  targets  generate  the  ranaining  number  of  elements 
in  the  target. 

The  ground-to-ground  firepower  processes  include  maneuver 
unit  ccmbat;  artillery  against  imneuver  forces  at  the  FEBA;  artil- 
lery against  other  targets  (other  artillery,  etc.);  and  minefield 
effects  against  naneuver  forces.  The  models  describing  artillery 
effects  against  maneuver  forces  at  the  FEBA  generate  estimates 
for  the  expected  number  of  surviving  elanents  in  a maneuver  force 
(by  weapon  system  type  and  personnel  in  that  unit) , and  the  model 
describing  artillery  effects  against  other  targets  generates 
estimates  of  the  expected  number  of  target  elanents  and  associated 
personnel  surviving.  The  minefield  effects  model  determines  the 
movement  delays  and  expected  number  of  surviving  elements  in  a 

^Including  the  effects  of  air  defense  artillery  engaged  in  a 
duel  with  attacking  aircraft. 
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maneuver  force  for  personnel  and  each  weapon  system  type. 

The  effects  of  firepower  (and  other)  processes  in  combat 
activities  between  maneuver  forces  at  the  FEBA  are  ccitputed  inter- 
nally using  VRI's  differential  models  of  combat.  These  models 
describe  the  dynamics  of  snail  unit  firelights  at  the  FEBA.  The 
models  explicitly  consider  different  weapon  system  types  on  each 
side  (tanks,  antitank  systems,  mounted  infantry,  etc.),  charac- 
teristics of  tliese  weapon  systems  (their  firing  rates,  accuracy 
of  fire,  projectile  flight  times,  lethality  of  the  projectile) , 
vulnerability  of  the  target  by  type,  firing  doctrine  of  the  wea- 
pon systan  (single  rounds,  Ixirst  fire,  volley) , probabilistic 
acquisition  of  targets  in  the  firelight,  allocation  priorities  of 
weapon  systems  to  targets,  maneuver  capability  of  the  weapon  sys- 
tems, and  the  effects  of  terrain  line  of  sight  on  acqtiisition  and 
fire  capabilities.  The  model  ccnputes  the  attrition  of  weapon 
systems  by  type  and  personnel  for  the  opposing  units  as  successive 
ranges  as  the  units  maneuver  during  the  engagement.  Based  on 
user-supplied  tactical  decision  rules,  the  force  nay  break  off  the 
ccmbat  activity  or  may  call  for  fire  support  or  both.  Output  of 
this  model  is  a ccnplete  description  of  the  surviving  weapons 
systems  by  type  and  personnel  at  tlie  end  of  tlie  combat  activity. 
I.IA  Corrmmid  and  Con-tlot  PlocUie^.  The  ccnmand  and  control 
process  models  in  VBCTOR-2  represent  tactical  decision  naking  at 
all  ccnmand  levels  from  theater  down  to  battalion.  These  nodels 
provide  a structure  within  which  the  user  may  input  appropriate 
"tactical  decisicn  rules"  that  describe  the  behavioral  and  deci- 
sion processes  which  are  an  integral  part  of  any’  military  activ- 
ity. A tactical  decision  rule  is  a rule  that  associates  a deci- 
sion (a  clioice  among  alternative  courses  of  action)  with  different 
sets  of  values  of  the  state  variables  of  the  model.  In  VECTOR-2, 
these  rules  take  the  form  of  user-defined  subprograms  in  the 
FORTRAN  computer  language.  The  user  (las  cotplete  flexibility  to 
specify  the  state  variables  that  cure  considered  in  the  rule  and 
and  the  functional  form  of  the  rule.  Essentisilly,  the  user  can 
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set  the  value  of  any  state  variables  as  a user-selected  function 
of  the  values  of  any  other  state  variables  contained  in  the  model. 

At  the  theater  level  of  ccmtand,  rules  viiich  perform  the 
following  functions  are  input  to  the  VBCroR-2  program 

(1)  assigiment  of  missions  to  sectors; 

(2)  assignment  of  maneuver  units  to  sectors; 

(3)  assigrment  of  non-organic  units^  to  sectors; 

(4)  assigiment  of  fixed-wing  aircraft  to  bases; 

(5)  assignment  of  sullies  and  replacement  weapons  and 
sectors; 

(6)  reassigrment  of  naneuver  units  from  one  sector  to 
another;  and 

(7)  assignment  of  missions  to  fixed-wing  aircraft. 

At  the  sector  level,  the  follcwing  functicais  are  performed  by 
tactical  decision  rules: 

(1)  assigiment  of  missions  to  subordinate  units; 

(2)  assigrrent  of  non-organic  field  artillery  to  divisions  ; 

or  separate  brigades; ^ \ 

(3)  assignment  of  non-organic  attack  helicopters  from  corps 
to  divisions  or  separate  brigades;^ 

(4)  assigiment  of  supplies  and  replacement  weapons  and  per-  i 

sonnel  from  sector  to  subordinate  units;  j 

(5)  assignment  of  missions  to  the  creation  of  task  forces;  j 

(6)  assigiment  of  attack  helicopters  from  divisicxi  to  j 

naneuver  units;  j 

(7)  allocation  of  ccrbat  air  support  to  front-line  maneuver  j 

units;  and  j 

(8)  assigiment  of  minefields  to  combat  arenas. 

I 

^A  base  set  of  tactical  decision  rules  developed  by  VRI  and 
military  staffs  over  the  course  of  a nimber  of  previous  studies 
is  available  to  users  of  VEX7IOR-2. 

^Non-orgeinic  units  are  those  air  defence,  attack  helicopter,  and 
field  artillery  forces  not  a part  of  US  corps,  divisions  or 
sepEurate  brigades  or  corresponding  foreign  units. 

3 

Or  to  corresponding  foreign  units. 
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At  the  level  of  the  battalion  task  force,  three  functions  are  per-  i 

formed  by  tactical  decision  rriles;  j 

(1)  situation  assessment  (possibly  resulting  in  a change  in  i 

activity  by  the  task  force  or  generation  of  a request  j 

for  support  from  a higher  headquarters) ; i 

(2)  response  frtxn  higher  headquarters  to  requests  for  sup-  I 

port;  and  ^ 

(3)  determination  of  target  priorities  and  allocation  of 

targets  bo  fire  support  resources.  j 

The  VBCTOR-2  ccnitand  and  control  pnscess  models  include  all  of  j 

these  user-provided  rules  as  well  as  a representation  of  the 
interactions  of  the  rules  with  each  other  through  the  ccrmand 
hierarchy  and  with  other  modeled  processes. 

2.2.3  Iittefftqence  and  TaAqzt  ^c.quAJ>ition  P^oce4Ae6.  VECTOR-2 's  ' 

representation  of  the  processes  of  intelligence  and  target  acqui- 
sition includes  models  representing  terrain  intelligence,  weather 
intelligence,  and  acquisition  of  ground  and  air  targets  for  fire 
support,  and  the  collection  of  air  and  ground  order-of -battle 
intelligence.  Weather  intelligence  is  represented  as  five-day 
forecasts  vdiich  are  input  by  the  user  for  each  day  of  simulated 
t corbat.  The  model  of  the  grourd  target  aoquisiticai  process  deve- 

lops and  nsintains  a list  of  the  expected  niufoer  of  acquired  tar- 
gets by  type  of  target,  location  of  target,  and  type  of  target 
acquisition  resource.  The  model  of  the  air  target  acquisition 
process  develops  and  maintains  a list  of  the  expected  nunber  of 
acquired  air  flights  by  location  of  the  flight  and  type  of  acqui- 
sition resource.  These  lists  are  used  by  tactical  decision  ruJ-es 
to  allocate  fire  support  to  the  acquired  targets.  The  order-of- 
battle  intelligence  process  model  utilizes  information  c^tained 
frcm  intelligence  resources  to  produce  estimates  of  the  number  of 
resource  groups  by  type  in  a given  zone,  the  estimated  strength 
of  maneuver  units,  both  front  line  and  reserve,  at  a given  point 
in  time,  and  estimates  of  the  nmber  of  aircraft  operating  in 
each  sector.  These  estimates  are  provided  cis  input  to  tactical 
decision  rules. 
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2.2.4  CommufucattoM  P/iocciie^.  The  comunic. iti<3ns  process  nuDdel 
in  VBCTOR-2  transmits  intelligence  and  comand  and  control  deci- 
sions throughout  the  command  hierarchy.  The  effects  of  the  ccmmu- 
nications  processes  are  represented  by  the  expected  value  of  delays 
incurred  in  transnitting  messages  from  their  origins  to  their  des- 
tinations. These  ccmmunications  lags  affect  the  ccmbat  process  by 
resulting  in  delays  in  initiating  and  inplementing  decisions. 

2.2.5  Loglitcu  P>ioc.ziiili . Logistics  processes  in  VBCTOR-2  in- 
clude the  consunption  of  supplies  represented  in  the  model  and  the 
replacanent  of  personnel  and  material  that  are  destroyed  or  con- 
sumed during  the  canpaign.  Consonption  of  supplies  occurs  as  the 
result  of  ccmbat  activity  and  the  passage  of  time.  Consunption  of 
ammunition  during  maneuver  unit  engagements  is  computed  at  each 
range  step  in  the  differential  models  of  ccmbat  based  on  the 
expected  nunber  of  rounds  fired  to  achieve  the  expected  attrition 
calculated.  In  other  ccmbat  activities,  expenditure  of  suf^lies 
is  ccmputed  on  the  same  basis  as  its  associated  firepower  process 
model.  For  exanple,  if  the  firepcwer  model  gives  effects  on  a 
per-sortie  basis,  peirallel  data  itans  give  aimunitiOTi  and  POL 
expended  per  sortie.  Consumption  of  si^^lies  based  siitply  on  the 
passage  of  time  is  intended  to  simulate  consunpticai  resulting 
from  activities  that  are  not  explicitly  included  in  the  model. 

The  consumption  process  models  used  in  VECTOR-2  are  generally 
linear  forms  representing  consumption  as  a sun  of  terms,  each  of 
which  is  the  product  of  an  irput  consumption  rate  and  a state 
variable  (generally  measuring  or  serving  as  a proxy  for  the  amount 
of  sane  activity) . In  addition  to  these  consumption  models,  reduc- 
tion in  supply  levels  may  occur  as  the  result  of  destruction  by 
firepower.  This  destruction  is  considered  as  part  of  the  fire- 
pcwer  process  models. 

As  weapon  systems,  target  aoquisitioi  resources,  ammunition, 
POL,  other  supplies,  and  personnel  are  attrited  or  consumed,  they 
are  replaced  in  accordance  with  user-supplied  tactical  rules.  The 
eurrival  to  the  theater  or  to  individual  sectors  of  these  new  wea- 
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pons,  personnel,  aivi  si^jplies  (as  well  as  entire  new  units)  is 
controlled  with  irput  generated  by  the  user.  Tactical  decisicxi 
rules  then  allocate  these  arrivals  first  to  sectors  (in  the  case 
of  arrivals  to  the  theater) , and  then  to  sitordinate  units  within 
sectors,  as  required. 

Z.2.6  Move/nent  Pwc&ii&i,  VBCTOR-2  explicitly  r^resents  air 
flight  and  maneuver  unit  movement.  The  initiation  of  movenent  is 
^vemed  loy  tactical  decision  mles  (possibly  delayed  by  camuni- 
cations  and  decision  lags) . Given  such  a decision  for  a front- 
line or  reserve  maneuver  unit,  close  conbat  and  non-combat  nove- 
ment  rates  (assault,  delay,  unimpeded,  etc.)  which  are  a function 
of  unit  oompositicn  are  used  to  represent  the  travel  of  the  unit 
from  its  origin  to  its  destinaticxi.  Similar  rates  are  used  to 
represent  the  movarvent  of  flights  of  attack  or  interc^tor  air- 
craft from  their  airbase  or  loitering  positicxi  to  their  target  and 
back  at  the  end  of  the  mision. 

2.3  StAuctMe  0|(  l/ECrOR-2.  The  process  models  outlined  in  the 
previous  sec:ticn  are  applied  repeatedly  during  a simulated  cam- 
paign in  VBCTOR-2  to  produce  a history  of  state  variable  values 
through  the  engagement.  These  process  models  are  applied  to 
several  levels  of  the  ccfimand  hierarchy  at  appropriate  points 
during  each  model  time  period  throughout  the  caitpaign.  Depending 
on  the  specific  process  and  ccmmand  level  represented,  the  size 
of  tie  time  steps  wittiin  a model  time  period  varies  in  order  to 
allow  for  adequate  representation  of  the  relative  timing  of  events 
during  a model  time  pseriod.  In  additicxi,  events  are  sequenced 
within  a time  step  to  allcw  for  further  timing  considerations. 

2.4  VECTOR- 2 Inputd  and  Outputs.  VBCIOR-2  requires  as  inpwt: 

(1)  data  which  describe  the  quantitative  performance  capa- 
bilities of  the  forces,  weapon  systems,  and  other 
resources  in  the  dynamic  processes  discussed  in  section 
2.2 

(2)  initial  force  and  sipply  inventory  data  and  a schedule 
of  unit,  weapon,  personnel,  and  si;pply  arrivals; 
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(3)  data  describii^  the  envirorment  (terrain  and  weather)  in 
which  these  forces  cperate;  and 

(4)  tactical  decision  rules. 

The  total  trajectory  of  most  state  variables  during  a caitpaign 
are  stored  for  use  by  a post-processor  v^iich  can  provide  aggregated 
statistics  on  detailed  information  in  the  form  of  tables,  grapiis, 
etc.  for  analysis.  Representative  rrcdel  outputs  include: 

(1)  mcxiel  time  period  and  cvmulative  weapon  system  losses 
by  weapon  type; 

(2)  model  time  period  and  cunulative  casualties; 

(3)  supply  totals  by  type  of  si^iply; 

(4)  total  weapon  systan  survivors  by  we^»n  type; 

(5)  veather  conditions; 

(6)  a map  of  the  battlefield  including  zones  and  their  ccm- 
positiOTis; 

(7)  acquired  targets  by  type; 

(8)  numbers  of  sorties  flown  on  each  mission  by  each  air- 
craft type; 

(9)  the  following  information  for  each  front-line  task 
force; 

(a)  number  of  weapon  systems  (by  type) , nvanber  of 
personnel,  and  supply  levels; 

(b)  minefields  deployed; 

(c)  FEBA  position; 

(d)  distance  the  force  TOved  during  the  current  time 
period; 

(e)  current  activity;  and 

(f)  reserve  units  employed; 

(10)  attributions  of  casualties  (by  location)  and  we^xsn 
system  losses  (by  type)  to  the  following  attrition 
agents: 

(a)  maneuver  unit  w^eapons  (and  ADA  in  the  case  of  heli- 
copter )d.lls); 
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(b)  fixed-wing  aircraft  (and  ADA  in  the  case  of  air- 
craft losses) ; 

(c)  field  artillery; 

(d)  attack  helicopters;  and 

(11)  unit  arrivals  pending  to  the  theater  and  to  each  sector. 


DISCUSSION 


Thonpson:  V4hat  sort  of  validaticxi  work  have  you  done  cn  this 
model?  What  combat  situaticns  have  you  prepared  and  input  to 
it? 

Bonder:  We  have  not  performed  a real  verification  in  the  scien- 
tific sense.  We  haven't  collected  war  data  to  do  this.  Although 
there  is  a set  of  data  available  now  if  pec^le  want  to  do  this 
(i.e.,  the  Mideast  War),  nobocfy  is  interested  in  verifying  it  for 
some  reason.  Let  roe  tell  you  vhat  we  have  dene.  The  roaneuver 
unit  combat  activities  that  are  in  VBCTOR-2  are  clearly  not  large 
scale  Monte  Carlo  simulaticns.  They  are  analytic  formulations  of 
the  engagesnents.  These  have  been  cerpared  with  high  resoluticn 
Monte  Carlo  simulations  of  the  maneuver  unit  combats  and  have 
been  shown  to  produce  very  similar  results.  All  I am  saying  is 
that  the  analytic  models  were  compared  to  models  that  the  mili- 
tary seems  to  think  are  realistic.  Both  models  could  be  wrong. 

I am  not  trying  to  nake  the  point  that  we  have  verified  it.  We 
have  cenpared  with  models  that  the  military  seems  to  think  des- 
cribe their  processes.  We  have  not  conducted  a verification 
study,  and  nobody  I know  has.  We  would  like  to  and  data  exists 
to  do  it. 

Question:  Do  you  have  the  Air  Force  cermand  and  control  simula- 
tion in  there? 

Bonder:  The  only  cemnand  and  control  elements  in  the  model  are 
for  the  maneuver  unit  conmand  structure.  Vfe  play  a lot  of  Air 
Force  decisions,  but  aircraft  exme  into  the  theater  by  unit  name 
and  then  they  get  deployed  to  airbases  \»tiere  they  lose  their 
identities  as  headquarters. 
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RiMARKS  OJ  TOE  PRESJNTATIGN  GIVEN  BY  SETH  BONDER 


by  J.  R.  THCMPSON 
dice  UncveAi-iti/ 


In  response  to  my  questitxi  as  to  the  capabilities  of  the 
interactive  made  of  VECTOR  II,  Dr.  Bonder  inf  arms  me  that  there 
is  no  such  mode.  Thus,  the  model  may  not  be  used  as  a simulator 
for  contand  training.  This  is,  in  my  view,  a serious  defect. 

In  response  to  my  question  as  to  the  validation  of  VECTOR  II 
by  case  studies  on  real  world  theatre  conbat  data.  Dr.  Bonder 
states  that  no  such  validation  has  been  conterplated,  although 
"validation" .against  earlier  conbat  models  indicates  sane  consis- 
tency with  earlier  generation  models.  I find  the  absence  of 
validation  with  historical  coitoat  data  to  be  a serious  defect. 

Of  course,  in  fairness  to  Dr.  Boirier  and  VECTOR,  I should 
mention  that  I had  anticipated  his  ansviers  to  my  questions, 
since  both  of  the  aforanentioned  defects  are  present  in  the  DOD 
li.rge  scale  models  built  at  a cost  of  millions  over  the  last 
dozen  years.  It  has  become  traditional  to  leave  real  time  man- 
made decisions  out  of  computer  conbat  models.  It  has  also  become 
traditional  to  "validate"  (n+l)th  generation  models  by  comparing 
them  with  (n)th  generation  models  instead  of  resorting  to  his- 
torical data.  If  the  present  models  have  much  relation  to  reality, 
then  I would  say  that  an  event  of  probability  measure  nearly  zero 
has  occurred.  To  keep  financing  generation  after  generation  of 
models  of  increasing  cost  and  complexity  without  ever  a reasonable 
attanpt  at  validation  is  sinply  throwing  good  money  after  bad. 

More  serious  than  the  wastage  of  a few  hundred  megabucks  is  the 
fact  that  these  models  ^u•e  used  as  pcurtial  jvistifiers  of  the  pur- 
chase of  billions  of  dollars  of  military  hardware.  Of  course, 
since  these  combat  models  are  no>t  constrained  by  consistenoy  with 
real  world  data,  they  do  have  the  "practical"  advantage  that  one 
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can  juggle  the  iiput  parameters  around  until  a predetermined 
weapons  policy  is  supported. 

Finally,  I should  like  to  make  a general  cament  about  sane 
prior  inpressions  reinforced  during  the  conference.  The  systans 
analyst  and  his  corputer  have  replaced  the  court  astrologer  and 
his  astrolabe  as  pseudo-scientific  aids  to  the  military.  On 
balance,  there  is  much  to  be  said  for  the  astrologer.  He  wrote 
his  reports  in  high  literary  Latin  and  had  a lower  overhead  rate 
than  that  of  his  modem  counterpai't. 

That  systans  analysis  should  hold  such  sway  in  the  DOD  is 
both  unfortunate  and  unnecessary.  The  asstrption  that  management 
science  techniques  with  slight  or  no  modification  are  applicable 
to  military  situations  is  not  sipported  by  experience— including 
the  Vietnam  War.  The  structure  of  military  decision  theory  should 
begin  with  military  history  and  take  its  axioms  form  that  body  of 
knowledge.  I vrould  suggest  that  high  priority  be  given  to  the 
creation  and  development  of  a science  of  quantitative  military 
science  (tactcmetrics) . Such  a science  would  undoubtedly  have 
sane  points  of  convergence  with  existing  mathematical  sciences 
(operations  research,  statistics,  ccrputer  science,  etc.).  But  it 
should  be  a science  sui  generis.  National  defense  is  sufficiently 
inportant  that  that  DO)  should  be  willing  to  undertake  the  admit- 
tedly difficult  task  of  creating  a new  science  tailored  for  mili- 
tary purposes.  To  continue  the  present  policy  of  assuming  that  a 
modelling  approach  vAiich  is  good  for  General  Motors  is  good  for 
the  DOD  would  be  both  expensive  and  risky. 
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STOCHASTIC  COMBAT  MODELING  - 
LANCHESTER'S  FIRST  LAW 

by  GEORGE  W.  SCHULTZ  and  CHRIS  P.  TSOKOS 
SI:.  PeteAibuAg  Junior  Cottzgz,  UtUvtuity  0|j  South  Vlontda 

Kbitn/xcX.  In  this  paper,  a stochastic  version  of  lanchester's 
Linear  Law  is  presented.  With  this  extended  model,  the  elimina- 
tion rates  and  the  operational  rate  losses  are  treated  as  random 
variables.  Liouville's  theorem  from  the  study  of  random  differen- 
tial equations  is  utilized  to  find  the  joint  probability  density 
function  of  the  solution  process  of  the  stochastic  system. 

Assuming  that  the  a priori  joint  probability  distribution  of  the 
random  initial  conditions  and  the  randan  rate  constants  is  multi- 
variable  normal, the  expected  values  and  the  standard  deviations 
of  the  solution  are  derived.  Their  trajectories  are  plotted  and 
ccrpared  to  their  deterministic  oounterparts . An  application  of 
the  system  is  given  for  heterogeneous  forces. 

1.0  IntAoductton.  In’ this  paper  we  shall  modify  lanchester's 
First  Law  of  Oontat  using  a stochastic  analysis  as  applied  to  the 
rates  of  elimination  between  the  enemy  forces. 

The  significance  of  the  concentration  of  troops  under  modem 
combat  ccnditiais  were  singled  out  by  F.  W.  Lanchester  in  1916, 

[4],  and  is  referred  to  today  as  Lanchester's  Law.  In  mathema- 
tical terms,  this  law  states  that  the  strength  of  a military  force 
is  proportional  to  the  average  effectiveness  per  unit  times  the 
square  of  the  number  of  units  in  the  conflict.  That  is,  the 
strength,  S,  of  a military  force  is  given  by 

S = kMu2  (1.1) 

where 

(i)  M is  the  average  effectiveness  per  unit,  and 

(ii)  U is  the  number  of  units  employed. 

This  fundamental  law  is  used  to  analyze  the  combat  between 
two  sides.  Blue  and  Red.  We  shall  assume  that  the  two  forces  are 
hcmogeneous,  and  that  the  number  of  units  of  the  Blue  and  Red 
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forces  at  time  t is  m(t)  and  n(t),  respectively.  Furthermore, 
eacJi  side  does  not  receive  reinforcements  after  the  battle  begins. 

Lanchester  used  law  (1.1)  to  state  two  laws  governing  the 
attrition  of  the  Blue  and  Red  forces.  These  are  the 
Linear  Law 


|dt  = ^"'' 

and  the 

Quadratic  Law 
dm  _ j™, 

S 

vdiere  c and  d (c'  and  d')  are  the  elimination  rates  that  a Red 
(Blue)  unit  destroys  a Blue  (Red)  unit  per  unit  time.  Law  (1.2) 
applies  to  oonfcat  at  close  quarters.  (The  Quadratic  Law  is  valid 
for  a long  range  ccrbat  situation.) 

We  shall  be  oonoemed  with  the  fomulation  of  a stochastic 
model  analogue  of  law  (1.2)  for  hcmogeneous  forces. 

It  seems  appropriate  here  to  give  a brief  suitmary  of 
previous  studies  on  this  subject  and  the  reasoning  vhich  leads  to 
our  analysis  below. 

Thrall,  [7],  concludes  that  the  number,  say,  of  Red  units 
destroyed  during  the  interval  of  tune  [0,T]  is  a random  variable 
with  an  ^proximately  normal  distribution.  The  variance  is  dis- 
regarded and  the  random  variable  is  replaced  by  its  mean,  p, 
yielding  a deterministic  approximation: 

^ ^ (1.4) 

dt  T 

The  solution  n(t)  is  a mean  representation  and  should  be  cottpared 
to  the  expected  value,  E{N(t)},  in  order  to  best  analyze  the  ran- 
domness inherent  in  this  real-life  situation.  Moreover,  opera- 
tional loss  rates  due  to  causes  other  than  enemy  fire  are 
disregarded  in  this  ntxtel. 


Stubbs,  et.  al.  [5],  consider  these  operational  rate  losses, 
but  treat  them  as  constants  with  tiite.  The  effectiveness  of 
any  ted  or  Blue  unit  is  determined  by  calculating  the  nntber 
of  enemy  units  that  it  can  destroy  per  unit  time.  They  may  be 
considered  to  be  the  random  variables 

Kgpj(Kj^) : rate  at  which  a Blue  (ted)  unit  destroys  a 
ted  (Blue)  unit  per  unit  time. 

The  operational  rate  losses  are  denoted  by 

kg^(kj^):  operational  rate  loss  of  Blue  (ted)  units 
per  unit  time. 

Utilizing  the  expected  values  of  and  they  obtained  the 
model 


dn 
dt 

^ = - E[Kj^]n  - k^m. 


(1.5) 


The  trajectories  for  n(t)  and  m(t)  will  be  based  cai  average  values 
for  and  Kj^  and  therefore,  the  model  (1.5)  is  deterministic. 
Engel,  [2],  treats  the  rates  kgjj  and  as  constants. 
Brackney,  [1],  considers  the  model 


dn 

at  m m 

dm  _ 
dt  = - W' 


(1.6) 


vAiere 

(i)  is  the  rate  at  vrfiich  a Blue  (ted)  unit  destroys 
a ted  (Blue)  unit, 

and 

(ii)  is  the  probability  that  a Blue  (ted)  unit  des- 
troys an  individual  ted  (Blue)  unit. 

This  model  omits  the  operational  rate  losses  ard  treats  tlie 
effectiveness  (destruction)  rates  by  a priori  probabilities, 
respectively. 

frfe  shall  extend  the  Lanchester  conbat  model  in  the 


P_  and  P, 
m ! 
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following  way: 

A(t)  = -K^n  - K^m 

N(t)  = -Kgj^  - Kg^n, 

with  randan  or  deterministic  initial  conditions 

M(0)  = Mq, 


N(0)  = Ng, 


(i)  ^ randan  rate  per  unit  time  that  a Blue 
(Red  unit  destroys  a Red  (Blue)  unit, 

(ii)  random  rate  of  non-oanbat  elimination 

of  Blues  (Reds)  per  unit  time. 

(iii)  M(t) (N(t)O  is  the  mean  square  derivative  of  N(t) 

(N(t))  at  t.  We  remark  here  that  the  random  coefficients  are 
time  independent. 

Figure  1 below  gives  a schematic  diagram  of  the  model  (1.7) 

(1.8). 


FIGURE  1 


and 


System  (1.7) -(1.8)  can  be  written  as 


pi 

1 

2:  • 

1 

A3  - A^ 


with 


vrfiere 


U(t)  = 


Nq  J 
M(t)‘ 
N(t). 


(1.9) 


(1.10) 


We  shall  adhere  to  the  follcwing  outline  in  this  paper: 

(i)  Assuning  an  a priori  joint  probability  distribution 
of  (^^,NQ,A^,A2,A3,A^)  nanely 

we  shall  find  the  joint  probability  density  functicn  of 
(M,N,A3,A2,A3,A^)  and  thus  the  joint  probability  density  function 

of  (M,N) . A stochastic  version  of  Liouville's  theorem  will  be 
enployed  to  loo]c  at  the  statistical  properties  of  the  above 
model. 

(ii)  The  trajectories  of  E[M(t)]  and  E(N(t)]  will  be 

ocrpared  to  the  deterministic  solutions  m(t)  and  n(t)  of  systan 
(1.9)  and  (1.10).  Also  the  trajectories  of  and  and 
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their  deterministic  counterparts  wiM  be  ocnpared  under  the 
assuitption  that  (Mq,Nq,Aj^,A2,A2,A^) is  distributed  as  multivariate 

nornBl. 

(iii)  We  shall  ej^ilain  how  the  theory  for  hotogeneous 
forces  can  be  adapted  to  heterogeneous  forces. 

Knowledge  of  the  joint  probability  density  function  of 
(M,N) , 

f(u;t)  =f(m,n;t),  (1.11) 

has  practical  significance.  One  might  wish  to  determine  the 
probability  that  the  force  levels  of  the  combatants  are  within 
certain  bounds  at  time  t.  This  is  acccnplished  by  evaluating 

y^f  (u;t)du, 

viiere  R is  the  appropriate  region  by  the  given  bounds  and 
represents  the  necessary  multiple  integral. 

2.0  Ve.tzHMLnatLon  of.  Some  StjoutUtiocUi  VhjoomXIu  of  thu  Random 


Solution  of  Sifitm  ().9)-(?.)0) . We  shall  begin  this  problem 
by  stating  seme  necessary  notation  to  be  used  throughout  this 
paper.  The  vector  differential  equation  (1.9)  can  lae 
ejqiressed  as 

U(t)  = h(U(t),A;t)  (2.1) 

with  random  initial  conditions 

C = U(0),  (2.2) 

with  randan  coefficients 

A=  (Aj^,A2,A3,A^)'^.  (2.3) 

The  joint  probability  density  function  of  C and  A is 

fo(£fa)-  (2.4) 

Ihe  randem  solution  of  equation  (1.9)  has  the  form 
U(t)  = a(C,A;t) 

= fg.  (C,A;t)- 

— (2.5) 

g2(C,A;t)  , 

vrfiere  g^,  g2  are  functions  of  t with 


c - 


L^O 


and 


A ^ (Aq^,A2#A2# A^)  • 

We  shall  now  iroke  use  of  the  fundamental  Liouville's  theorem 
in  the  theory  of  dynamic  systans.  A proof  of  this  theorem  is 
given  by  Syski,  [6].  An  alternate  proof  of  concept  of  charac- 
teristic functions  is  due  to  Kozin,  [3]  Theorem  (2.1).  Consider 
a vector  differential  equation  (2.1) 

U(t)  = h(U(t),A;t) 

with  random  coefficients,  A.  The  joint  probability  density 
function  of  C and  A is 

fo (c,a) . 

Assume  that  the  solution  of  equation  (2.1), 

U (t) , 

exists  in  the  mean  square  sense.  Then  the  joint  density  function 
of  n(t)  and  A, 

f(u,a;t)  (2.6) 

satisfies  the  Liouville  equaticn 

n-tm 

+ II  MML 

j=l  ^'^j 


H (H-a;t) 


0, 


(2.7) 


vAiere 

(i)  hj  and  Uj  are  the  j ocnpcaients  of  the  vectors  h 
and  u. 

(ii)  The  dimensions  of  the  vectors  u and  a are  n and  m, 
respectively.  Formula  (2.7)  is  useful  particuleurly  when  the 
dimension  of  the  Jacobian  is  large. 

We  thus  see  that  the  problem  of  determining  the  joint  pro- 
bability density  function  f(u,t;a)  using  the  Liouville's  theorem 
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! 

j 


is  an  initial  value  prc±)lem  for  first-order  partial  differentieil 
equaticns,  the  initial  value  being  the  joint  prctoability  density 
function  of  C and  A,  f^ {c,a) . 


The  general  solution  of  equation  (2.7)  is  readily  cAitained 


by  examining  the  associated  Lagrange  system 

dt  _ df  _ ‘^l  _ _ dun 

"T  “ fv.hiu.ait)''  fj^  ■■■  f^  ' 


(2.8) 


vdiere 

(i)  V-h  is  the  divergence  of  the  vector  h. 

The  first  equality  in  equation  (2.8)  yields  the  solution,  the 
joint  projbability  density  function  of  U and  A, 

f (u. 


a;t)  = fg(£,a)  exp 


I 

1 /n  7-Mu  = £(c,a;T) , 


a;T]dT 


£ = £ ^(u,a;T) , 


(i)  2.(C,A;t)  is  the  explicit  solution  of  U(t) . 

The  joint  probability  density  function  f(u;t)  of  (M,N)  is 
obtained  from  equation  (2.9)  as 

f(u;t)  = (u,a;  t)  da 

■ LLLL  f (u,a;t)daj^da2da2da^.  (2.10) 

Vfe  shall  now  apply  the  above  theory  to  the  extended  ntxlel 
(1.9)-(1.10) , which  is  expressed  as 

f-  A2M(t)  - - A^N(t)] 


0(t)  = 


A3M(t)  - - A^N(t)_ 


= h(U(t),A;t), 
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C=  (M(,.Nq)\ 


A=  (A^.A2,A3,A4)  , 


and 


r 3 n 

3M 


V-h  = 


3_ 

3N 


(2.12) 


= - (A3  + A^)  . 

We  shall  nc3w  solve  equation  (2.11)  for 
U(t)  = 2(C,A;t) , 

and  use  equation  (2.9)  to  find  the  joint  probability  function  of 
U(t)  and  A,  naitely, 

(2.13) 


f(u,a;t)  = f (m,n,a3,a2,a3,a^;t) , 


We  assutne  a solution  of  equation  (2.11)  of  the  form 

iti 


u(t)  4 


ae 


tBe^^J 


(2.14) 


A ncai-trivial  solution  of  equaticai  (2.1)  exists  if  and  only  if 

(2.15) 


■10' 

■-®2  -^r 

X 

- 

. 0 1. 

-■®3  "^4- 

= 0. 


Ihe  solutions  for  the  eigenvalues  in  equation  (2.15)  are 

2 


'1  = 


(aj+a^)  + >^2“®4  ^^i®3 


(2.16) 


and 


^2  = 


- (a2+a^)  - /(a2-a^)^  + ^®i^3 


(2.17) 


We  note  that  since  a3,a2,a3,a^  eae  all  positive,  we  have 

(a2-a^)^  + 4a3a3  > 0. 

The  particular  solution  of  equation  (2.11)  subject  to  the  initial 
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condition 


U(t)  = 


f’o 


L^OJ 


/\,t  A.t  A-t  A,t  1 

R^e  -P^e  ^ -R^R2  (e  -g  ) 


Alt  A2t 
Le  -e 


Alt  A-t 
-I^e  +Rie 


vtere 


and 


if  we  let 


h ■ AifA^ 


(2.18) 

(2.19) 


A2+A2 


B = 


\.t  A-t  A,  t A_t 

-R2e  -RiP2(  ^ -e  " ) 

A,t  Ayt  A.t  A-t 

e -e  -^2'=  +Rie 


equation  (2.18)  taJtes  the  form 

U(t)  = a(C,A;t) 

=BC, 

which  gives  us 

C=^  (Rl-R2)B"Vt)  . 

Furthermore,  vie  can  easily  obtain 


(2.20) 

(2.21) 


„-l 


7^7^ 

(Rl-R2)2e 


Alt  A2t 


A,t  A-t. 


A2t  Alt  (A  t + A )t 

RiG  ^ 


e -e 


Substituting  the  expression  for  B ^ as  given  by  equation 
(2.22)  into  equation  (2.23)  we  cbtain 


(2.22) 


c ^ 


-A_t  A,t  -A-t  -A.t, 

-R^e  +i^e  R^R2(e  -e  ^ ' 


-Aj^t 

e -e 


-At  -At 
R^e  -R2e 


tJ(t), 


(2.23) 

Frcm  equation  (2.9),  ti)e  jojjit  probability  density  function  of 
(M(t),N(t),A^,A2.A2'A4)  is 

f (rn, n , a^^ , a2 , a^ , a^ j t)  — fQ(n^,nQja^,a2,a^,a^) . 


ejqj 


A I 

- / 7-Mt 


(2.24) 


vAiere 


-i/ 

"m" 

= a 1 

\ 

n 

as  given  by  equation  (2.23) . 
From  equation  (2.12)  we  obtain 


p.Mr  . - 


-(a2+a^)dT  = (a2+a^)t. 


(2.25) 


Hence,  substituting  tile  expression  for  C given  by  equation  (2.23) 
and  the  expression  for  - /"^v-hdr  from  equation  (2.25)  into 

Jo 

equation  (2.24) , we  have 

f(u,a;t)  = f (m,n,aj^,a2,a2,a^;t) 

’ "^2^,_  “^l^m 

e 


= ejq)  [ (a2+a4)t]fg{j:pj:-[  (-r2e  +rj^< 


-Xjt  -A]^t 


1 , ^1^  "^2^ 


+ r r (e  - -e  )n],:^[e  " -e  ^ ]m 
J.  ^ rj^r2 
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)n], 


“^2^  -A,t 

+ {r^e  -r^e  )n].  (2.26) 

Itie  joint  (tensity  function  f(u;t)  is  obtained  from  equaticai 
(2.26)  by  integration  with  respect  to  a,  that  is. 


7 / / 


from  equation  equatj-on  (2. 1C) 

The  r*  moment,  E{tF(t)},  of  the  solution  process  U(t) 


czin  be  found  from  the  formula 


(t)f  (u;t)du. 


However,  to  vzury  our  approach,  we  shall  calculate  the  r 
mettEnts  of  M(t)  and  N(t)  by  the  fomulau: 


E{M’^(t)}=  j j g^(c,a;t}fQ{c,a)doda,  (2.27) 


E{N^(t)}  =y  j g2(c,a?t)fQ(c,a)cteda,  (2.28) 

where  fQ(c,^)  is  the  joint  density  funertien  of  tie  randan  vsu'iables 
C and  A. 

In  order  to  nalte  the  notatiai  more  standard,  we  denote  the 
r2uidcri  variables  Mp,NQ,A(,A2,A2,  eind  by 

Xi=Mo, 

X2  = Nq, 

:<3  = A(, 

X4  =A2, 

X5  = A3, 

^6  ' *4' 


r 


I 


•i 

ii 


Vfe  shall  study  the  first  and  second  unneiits  of  the  solution 
process  for  U(t)  for  several  cisses. 

Cage  I:  i Xj^,  r X2  with  probability'  one  and  (X2,X^,X^,Xg) 

is  distributed  as  truncated  multivariate  normal.  For  this  case, 
let 

X = (X3,X4,Xg,Xg)'^,  (2.29) 

and 

T 

^ " ^3' ^4 ' '''s ' '*5'  ^ ^2.30) 

where 

Uj  = Ew\},  i = 3, 4, 5,6 

The  joint  prt4xat-.il ity  density  function  of  is 

given  by  I 1 T 

, K/P- 

t„(X;P,pW=  -e  , x,,x.,x,.,x,  > 0 

J (2ti)2  3 4 5 6 

( 0,  elsewhere,  (2.31) 

where 

(i)  K is  a truncation  factor, 

(ii)  P = c-i, 
with  C given  by 

r *^33  °34  ‘^35  °36  1 


C = 


"63 


"66 


wivere 


Oij  = E{[X^-p^]fXj-Vj]} 


31 


i,j  = 3, 4, 5, 6. 


Using  equacLais  (2.18),  (2.27),  (2.28)  and  (2.31)  we  obtain 


E{M(t)}  = 


-/o7o7o7:w[(-‘^v^) 
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+ I -r j^r2e  +r I f q (X ; P , p ) dX3dX4dX5dXg , 

(2.32) 

/ ^1*-  ^2^  \ 

+ / -r2e  +r3e  1 X2  (X;P,p)dx3dx^dX3dXg, 

(2.33) 

w[(v ' v^‘ ) 

' ' \)  (2.34) 

and 

00  00  oo  00 

E[N^(t)]=K/  f f f n^(t)fQ(X;P,p)dx3dx4dX3dXg, 

■^0  '' 0 ■'0  •'0  (2.35) 

vAiere  n(t)  is  given  by  equation  (2.18). 

The  standard  deviations  a„,. . and  o.,,,,  aire  ccilculabed  from 

M(t)  N(t) 

the  formulas 

°M(t)  " {®f”^(t)]  - E^[M(t)))^/^,  (2.36) 

= {E[N2(t)]  - E2[N(t)]}^/^.  (2.37) 

Case  2;  (Xj^,X2)  distributed  as  bivariate  normal  and  X3,X^,X3,Xg 

are  constants,  namely 

X3  = a, 

X4  = b, 

Xg  = c. 


Xg  =d. 


For  this  case, 


X = (X^,X2)", 
T 


^ ^ ‘^11  '^12 


and 

P = c“^ 

Hie  joint  prdiability  density  function  of  the  bivariate  randan 
variable  (X^,X2)  is 


exp 


2iro^02»^;^  ^ 2(l-p2)LV  / 

fo(x^,X2;p^,n2-<’i,02^  = j - 2p  ^ ^ j + ^ j 

0 < X2/X2  < “ 1 < p < 1, 

0,  elseidiere,  (2.38) 

vrflere  K is  a truncation  factor. 

Fran  equation  (2.19)  defining  r^^  and  r2,  we  have  for  this 

case 


and 


1 ' 


^2  ^ A, 4b  ' 


viiere  and  X2  are  given  by  equations  (2.16)  and  (2.17).  Thus 
v«  have 


_ 00  ^00 


E[M(t)  ] = //  m(t)  fg  (Xj^,X2)dXj^dx2, 


(2.39) 


0 0 
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E[N(t)]  = / / n(t)fQ(Xj^,X2)dXj^dx2, 

•'o  •'o 


(2.40) 


00  00 

E[M^(t)]=  r f m^(t)fQ(Xj^,X2)dx^dx2, 

Jo  Jo 

00  00 

E[N^(t)l=  / / n^(t)fQ(Xj^,X2)dx^dx2, 

■'  0 •'  0 


v*iere 


(2.41) 


(2.42) 


(i)  m(t)  emd  n(t)  are  given  by  equaticxi  (2.18) 

(ii)  fQ(x^,X2)  is  given  by  equation  (2.38) 

The  standard  deviations  a,.,. , and  a,,,. , are  calculated  from 

M(t)  N(t) 

formulas  (2.36)  emd  (2.37). 

If  p = 1,  X2  becctnes  linearly  related  to  that  is. 


^2  ~ ^^1 


(2.43) 


\4iere 


emd 


® = ^^2  - ^ ‘'I 

" ‘'2  " ^*"1  (2.44) 

In  this  case,  we  need  only  the  density  function  for  X^^,  namely 

1 — exp  } ( , X,  >_  0 

fo(Xi)  = r^'^l  < ^ 

I 0,  elsevdiere.  (2.45) 

From  equation  (2.18)  we  observe  that  both  M(t)  and  N(t)  are  func- 
ticns  of  Xj^  = Mq  only,  since  the  elimination  rates  are  constants 

and  p = 1.  Thus,  we  can  write 
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M(t)  = T(I^) 

= T(Xj^),  (2.46) 

and 

N(t)  = V(Mq) 

= V(X^).  (2.47) 

Henoe,  using  equations  (2.46)  and  (2.47)  vie  liave 

E(M(t)]  = J T(Xj^)fQ(x^)dXj^, 

E[N(t)]  = V(Xj^)fQ(Xj^)dX3^, 

E[M^(t)]=y  T2(x^)fQ(Xj^)dXj^, 

and 

E[N2(t)]=y  v2(xj^)fg(xj^)dx^. 

As  (aefore,  and  a.,,..,  eire  cfctained  from  formulas  (2.36)  and 

M(t)  N(t) 

(2.37) . 

Case  3:  lastly,  vge  shall  consider  ttie  case  where  (Xj^,X2,X2,X^,Xg, 

X,)  are  distributed  as  truncated  multivariate  normal.  Here  ws 
o 

have 

X = (X^,X2,X2,X^,X5,Xg)  , 

T 

and  the  joint  probability  density  function  of  (X^,X2,X2,X^,X^,Xg) 
is 

1 Ki/IpT  1 T 

, exp  {4(X-  )^P(X-y)}, 

(27r)3  ^ 

fQ(X;P,y)  = j x^  > 0,  i = 1,2, 3, 4, 5, 6, 

\ 0,  elsewhere,  (2.48) 
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viiere 


In  figure  3.  lA,  the  randan  initial  rates  were  assimed  to  be 
independent,  that  is  p = 0.  For  figure  3.2A,  we  let  p = .5. 

Noticeable  differences  between  the  stochastic  and  determi- 
nistic trajectories  occurred  at  time  t = .65  units  for  both  cases. 
The  Red  force  was  destroyed  much  more  rapidly  than  the  Blue  force. 

We  remark  that  the  erratic  behavior  of  the  trajectories  for 
E[N(t) ] in  both  figures  was  due  mainly  to  round-off  error. 

4,0  He-teAOq^noai  Fo^cfc6.  We  shall  now  study  the  above  theory 
as  applied  to  heterogeneous  forces. 

The  Blue  and  Red  forces  can  be  represented  by  the  two 
vectors 

m(t)  = (raj^(t),  m2(t),...,  iKpCt)), 

and 

n(t)  = (nj^(t),  n2(t),...,  n (t)), 

vhere 

(i)  m^(t)  is  the  nuittoer  of  the  i^  hanogeneous  Blue 
force  oonponent  reraining  at  time  t ^ 0, 

(ii)  n^  (t)  is  the  nurtber  of  the  j^  hanogeneous  Red  com- 
ponent remaining  at  time  t ^ 0. 

In  this  secrtion  we  shall  assume  all  the  conponents  are  canbat- 
oriented,  that  is,  all  are  capable  of  destroying  an  eneity  unit 
or  of  being  eliminated  by  an  enery  unit,  i.e.  tanks,  trucdcs, 
artillery,  men,  etc. 

Thrall,  [7],  studied  the  numerous  catplications  which  arose 
in  deciding  priority  orderings  of  enemy  cxnponents.  For  example. 
Blue  tanks  may  be  ordered  to  fire  at  Red  planes  first,  then  at 
Red  artillery,  then  at  Red  tanks,  etc.  Vfe  shall  assxjme  that 
attacks  shall  be  directed  at  any  observed  enemy  unit,  with  no  hos- 
tile caiponent  having  a priority  of  being  attacked  over  any  other 
hostile  unit.  Moreover,  no  corponents  shall  receive  reinfoioe- 
ments  onc:e  the  battle  begins. 
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riGUic:  3.1A 


KAilDOM  n'r'i'TAl,  VAI.ll!;S  DISTRIBUTCD  AS 


TKLIK'CA’ITn  BIVARIATr  IJORKiAL,  p = 0 


3.50 


^ 

4.50 


n 
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7.50 


n 
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TIME  X 10"* 
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FIGURE  3.2A 


RANDOM  INITIAL  VAL.UFS  DISTRIRUTED  AS 


TRUNCATED  BIVARIATE  NORMAL,  p = .5 


BLUES 
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riGURE  3.2B 

RANDOM  INITIAL  VALUES  DISTRIBUTED  AS 


3.50  4'.  SO  5'.  so  s'.  50  7'.  so  8 '.50 

TIME  X 10- ‘ 


REDS 
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Before  stating  the  Linear  Law  Lanchester  mcdel,  a brief 
discussion  of  a previous  nathematical  analysis  of  heterogeneous 
forces  is  in  order.  Fran  Thrall,  [7],  the  following  terns  are 
defined  or  derived: 

set  of  those  ^(1  ^ q)  such  that  Red  cortponent  t 

has  a higher  priority  than  j for  Blue  conponent  i, 

visibility  coefficient  for  Red  ^ against  Blue  i, 

T^:  firing  period  for  Blue  i, 

and 

j : elimination  prcfcability  for  Blue  i against  Red  j . 

Frcm  the  above,  the  fol lowing  infomation  was  obtained: 

"'^il^l^i 

e : probability  that  a matber  of  Blue  i sees  no 

meirbers  of  Red  t in  the  firing  period  x^,  where  n^^  is  the  nunber 

of  units  in  Red  oonponent  t, 

”^°"il‘‘l^i 

q^j  = e : probability  that  a meitber  of  Blue  i sees 

no  matbers  of  any  Red  t,  t z 
-a . .n  .T  . 

P^j  = 1-e  ^ probability  that  a neiber  of  Blue  i 

sees  at  least  one  member  of  Red  j, 

• probability  that  a member  of  Blue  ocnpo- 

nent  i destroys  a member  of  Red  ocrponent  j,  and 

— i:  expected  attrition  to  Red  ccnponent  j from  Blue 

component  i. 

Frcm  the  above,  the  total  attrition  of  Red  component  i is 

developed  by  taking  the  sum  of  the  above  ^i^ij , vhich  are  ave- 

"i 

rages.  Hence,  we  obtain 
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dn. 

dt 

or,  using  matrix  notation, 


P 

IT— ' m.  V . . 

N in 


i=l 


vrtiere 


dn 

S = - ml’ 


M.  . 

r =-iJ. 

T . 

1 


dn 


A similar  approach  is  used  to  find  gf  • 

We  shall  iirprove  this  approach  by  treating  these  rates 
'’i-i 

as  randan  variables,  as  was  done  for  the  hanogeneous  case  in 

secticai  3.1.  In  Ihrall,  [7],  the  linear  and  quadratic  laws  were 
intermingled  into  the  model  according  to  whether  a^^^n^^T^and 

“ijnj^i  large  or  small.  For  this  part  of  the  paper,  we  shall 

assime  that  ~ because  S^j  = (p,  since  no  priorities  are 

given.  The  heterogeneous  linear  model  is 


U(t) 


0 

0.. 

0 

-^1 

^2  ••• 

0 

0.. 

0 

-^1 

"*22  ••• 

-^q 

0 

0 

0...-A^ 

-A  1 
pi 

-A  . ... 

P2 

”*pq 

U(t) 

-®11 

-«12 

O...-B1P 

0 

0 

-®21 

■®22 

a 

1 

0 

0 

-B2  ••• 

0 

-B  T 

_qi 

-B  T 
q2 

0...-B 

qp 

0 

0 ... 

"®q_ 

(4.1) 
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where  the  randan  variable  rates  are 

(i)  ^ a Red  unit  j (Blue 

unit  i)  destroys  a Blue  unit  i (Red  unit  j)  per  unit  time, 

(ii)  A^  (Bj)  is  the  operational  rate  loss  per  unit  Blue 

(Red)  per  unit  time, 

(iii)  U(0)  = (Mj^Q,M2Q,...,r^,Nj^Q,N2Q,...,N  ) is  the 

vector  of  randan  initial  caiditions; 
and 

U(t)  = (M^(t),M2(t),...,Mp(t),N^(t),...,Ng(t))'^. 

Equation  (4.1)  with  the  randan  initial  conditions  U(0)  is  a sys- 
tem of  p + q linear  differential  equations,  \diich  is  solvable  by 
the  method  used  in  the  solution  of  system  (1.9)  - (1.10).  Assu- 
ming an  a priori  probability  distribution  for 

C = U(0) 

and 

A — ’ * * '^lq'^'^1'  * * * '^q'^'  • • • / 


®ql'®q2'-"'V  ' 


namely. 


fg (C/a) , 


we  can  find  the  joint  probability  density  function  for  U and  A 
fron  the  equation  (2.9)  and  the  prcfcability  density  function  f(u;t) 
from 


[f  f 

^ —CO  — oo  •'  —a 


f (u,a;t) da^j^daj^2‘  • 


Expected  values  are  calculated  in  an  analogous  manner  to  those 
found  in  section  2. 
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RANDOM  INITIAL  VALUES  DISTRIBUTED  AS 
TRUNCATED  BIVARIATE  NORMAL,  p = 0. 
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FIGURE  3.2A 


RANDOM  INITIAL  VALUES  DISTRIBUTED  AS 


TRUNCATED  BIVARIATE  NORmL,  p = .5 
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Number  of  Survivors 


FIGURE  3.2B 


RANDOM  INITIAL  VALUES  DISTRIBUTED  AS 
TRUNCATED  BIVARIATE  NORMAL,  p = .5 


E[N(t)] 


n(t) 


AN  EXAMPLE  OF  DATA-POOR  MODEL  "VALIDATION"* 


♦ 


f’ 


by  JAMES  R.  THQMPSCW 
nice  UtUveAi-itij 


t 

During  this  conference,  I have  repeatedly  mentioned  the 
futility  of  a data-free  model  "validation"  process.  An  example 
of  this  can  perhaps  be  given  by  considering  a study  vihich  was 
not  data-free  but  only  data-poor.  In  1954,  J.  H.  Engel  [1]  pub- 
lished a well  known  study  which  attenpted  to  verify  the  applica- 
tion of  lanchester's  first  law  to  the  casualty  data  of  the 
Japanese  and  American  sides  during  the  battle  of  Iwro  Jima.  The 
model  he  considered  was 


^ = P(t)  + Ay 

^ = 
dt 


Bx 


(1) 


where  X and  Y denote  the  American  and  Japanese  strengths, 
respectively,  and  P(t)  denotes  resupply  to  the  American  side. 
Although  incremental  casualty  data  was  available  for  the  Anerican 
side,  there  was  no  such  information  for  the  Japanese  side  — only 
rough  estimates  of  the  strengths  at  the  beginning  and  end  of  the 
battle.  Inasmuch  as  the  American  side  suffered  less  than  30% 
casualties,  it  is  not  surprising  that  the  first  law  equations 
gave  results  which  agreed  very  closely  with  the  observed  values 
of  X(t) . Hcwever,  the  test  of  the  itodel  should  lie  also  with  the 
reproducibility  of  the  Y (t)  values  which  were  reduced  over  95% 
during  the  course  of  the  battle.  (Engel  assumes  that  the  Y 
force  was  reduced  to  zero  in  36  days.  However,  constant  Japanese 
resistance  — however  ineffective  — lasted  for  over  a month  after 
the  end  of  the  36  day  period.  On  the  day  after  the  battle  was 


* Supported  by  STAG  Contract  DAAB09-71-R-0063  and  ONR  Grant 
NR042-283. 
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"over",  20  Japanese  were  killed  in  a banzai  charge.  Prisoners 
were  taken  daily  during  the  month  of  April  1945  with  as  nany  as 
70  taken  on  one  day,  pp.  284-287  (2). 

Fortunately,  vie  do  have  a piece  of  information  as  to  the 
Japanese  strength  during  an  intermediate  point  of  the  battle.  On 
tl>o  21st  day  of  combat  the  Japanese  cannander.  General  Kuribay- 
ashi,  estimated  that  he  had  around  1500  men  (p.  268  12]).  Using 
the  quadratic  law,  we  obtain  a figure  in  excess  of  8550  — 
almost  six  times  Kuribayashi ' s figure. 

It  is  not  unreasonable  that  seme  scattering  of  forces  would 
cause  Kuribayashi ' s estimate  to  be  on  the  low  side,  but  not  by  a 
factor  of  six.  In  fact  the  reduction  of  the  Japanese  force  by 
approximately  20,000  in  the  first  21  days  followed  by  a reduction 
of  around  10%  of  that  figure  during  the  next  15  fays  hardly  indi- 
cates that  Lanchester's  first  law  with  constant  coefficients  is 
operative.  One  is  tenpted  to  try  Lanchester's  second  law 

^ = P(t)  + Axy 

(2) 

dy 

Bxy. 

Since  Lanchester's  second  law  never  leads  to  annihilation  of 
either  side,  we  shall  not  try  to  obtain  constants  wiiich  give 
Y = 0 for  t = 36  but  instead  closely  match  the  first  law 
values  of  X and  Y for  t = 35.  A coiparison  of  the  two  laws 
is  given  in  Appendix  I.  We  note  that  for  t = 21,  the  Y force 
has  a value  of  2350,  considerably  closer  to  Kuribayashi ' s 
estimate  of  1500  than  was  tie  first  law  figure  of  8550. 

There  is  certainly  no  attaipt  here  to  advocate  that  the 
second  law  is  the  correct  model  for  the  battle  of  Iwo  Jima.  The 
X values  given  by  the  first  law  model  are  generally  closer  to 
the  actual  values  than  are  the  second  law  values  — though  X 
relative  errors  are  small  for  both  models.  The  point  is  that  an 
excellent  fit  of  a model  to  the  force  values  of  one  side  — and 
that  side  the  least  scathed  — does  not  mean  a great  deal. 


i 


I 


I 

i 


It  is  suggested  that  the  mixed  law 

P(t)  +Ay 


dt 


Bxy 


(3) 


might  be  useful  in  ccmbats  with  disparity  of  force  strengths.  It 
is  also  suggested  that  the  first  law  might  be  generalized  by  con- 
sidering 


^ = P(t)  + k(t)Ay 
^ = ^(t)Bx 


(4) 


v4iere  k(t)  = % of  effective  possible  fire  directed  by  force  Y 
against  force  X. 

f.(t)  = % of  effective  possible  fire  directed  by  force  X 
against  force  Y. 

This  would  handle  such  factors  as  the  fact  that  in  a battle  with 
disparate  force  ratios  — as  at  Iwo  Jima  — much  of  the  stronger 
force  will  be  inactive. 

In  general,  a mixed  force  operation  such  as  Iwo  Jima  (viiere 
naval  gunfire  was  extremely  inportant)  should  probably  be  handled 
via  heterogeneous  force  equations. 
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APPENDIX  I 


First  Law  Second  law 


A = 

.0545  B 

= -.0107 

A = -1 

90  X 10  ^ B = 

-1.91  X 10 

t 

X(t) 

Y(t) 

t 

X(t) 

Y(t) 

1.0 

52833 

21217 

1.0 

52937 

20432 

2.0 

51692 

20658 

2.0 

51017 

18502 

3.0 

56582 

20078 

3.0 

55420 

16715 

4.0 

55504 

19479 

4.0 

53599 

15066 

5.0 

54458 

18891 

5.0 

52160 

13619 

6.0 

66446 

18244 

6.0 

63739 

12191 

7.0 

65471 

17538 

7.0 

62364 

10808 

8.0 

64534 

16843 

8.0 

61168 

9605 

9.0 

63634 

16157 

9.0 

60123 

8555 

10.0 

62772 

15481 

10.0 

59206 

7634 

11.0 

61947 

14813 

11.0 

58399 

6823 

12.0 

61158 

14155 

12.0 

57687 

6107 

13.0 

60404 

13505 

13.0 

57057 

5473 

14.0 

59685 

12862 

14.0 

56497 

4910 

15.0 

59002 

12227 

15.0 

56000 

4410 

16.0 

58352 

11599 

16.0 

55556 

3965 

17.0 

57737 

10978 

17.0 

55161 

3567 

18.0 

57156 

10364 

18.0 

54807 

3211 

19.0 

56607 

9755 

19.0 

54490 

2893 

20.0 

56902 

9152 

20.0 

54206 

2608 

21.0 

55610 

8554 

21.0 

53952 

2352 

22.0 

55160 

7962 

22.0 

53723 

2122 

23.0 

54742 

7374 

23.0 

53518 

1915 

24.0 

54356 

6790 

24.0 

53333 

1729 

25.0 

54001 

6211 

25.0 

53166 

1562 

26.0 

53679 

5635 

26.0 

53017 

1411 

27.0 

53387 

5062 

27.0 

52881 

1276 

28.0 

53127 

4492 

28.0 

52760 

1153 

29.0 

52897 

3925 

29.0 

52650 

1043 

30.0 

52699 

' 3360 

30.0 

52551 

943 

31.0 

52531 

2797 

31.0 

52461 

853 

32.0 

52394 

2236 

32.0 

52380 

772 

33.0 

52287 

1675 

33.0 

52307 

698 

34.0 

52211 

1116 

34.0 

52241 

632 

35.0 

52166 

558 

35.0 

52181 

572 

36.0 

52150 

0 

36.0 

52127 

518 

x(0)  = 0 

y(0)  = 21,500 

P(t)  = 54,000  if  0 < t £ 1 

= 6,000  if  2 < t _<  3 

= 13,000  if  5 < t < 6 

= 0 otherwise 
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DISCUSSION 


Questicn:  There  is  a method  I think  to  what  you  say  and  that  is 
that  in  all  the  technical  ootnnunities  we  don't  have  the  legal  and 
itedical  analog  of  forensic  judgment.  There  are  legal  ejqaerts. 
There  are  medical  experts.  There  are  accountants  who  are  CPA. 
There  are  all  manner  of  professions  that  require  forensic  judg- 
msnts.  We  do  not  have  the  analog  of  that  in  the  technical 
cominity.  We  do  not  the  analog  of  that  especially  in  the 
analysis  ccmnunity.  I regard  engineering  as  self-regulating. 

But  in  this  mega  world  of  operations  research,  which  forms  as 
a habit,  the  signposts  are  very  foggy.  The  point  I am  trying  to 
make  is  that  maybe  you  have  beocme  one  of  those  forensic  scien- 
tists. 

Kalaba:  By  the  way,  it  is  interesting  that  you  should  bring  up 
legal  aspects.  I really  vvondered  about  that.  I wonder  if  the 
comnander  is  anywhere  authorized  legally  to  surrender 

any  of  his  responsibility  bo  what  any  black  box  says.  This  is  a 
very  interesting  question. 

Welch:  I would  like  to  return  to  another  matter.  The  problem  of 
cooperation.  I assimilated  the  notion  early  on  of  forming  plans. 

I remerber  the  phenorenal  statement  that  that  was  a creative  act. 
Let  me  talk  about  another  aspect  of  the  plan.  let  me  propose  that 
one  of  the  ways  in  which  one  can  model  the  military  processes 
that  it  is  an  indirect  process  in  which  a plan  is  created.  A 
great  deal  of  time  and  attention  is  then  spent  by  people  trying 
to  follow  the  plan.  Time  is  spent  by  people  on  top  to  see  if,  in 
fact,  people  are  following  the  plan.  Perhaps,  by  locking  for  new 
infomation  to  see  if  the  plan  should  continue  to  be  follcwed  or 
perhaps  abandoned.  But,  in  fact,  the  plan  becomes  an  essential 
organizing  feature.  That  bears  on  the  question  of  cooperation. 
It's  not  at  all  clear  to  me  but  that  it  isn't  true  that  the  real 
enery  of  effective  military  operation  is  chaos,  not  bad  decisions. 
This  goes  alcug  with  a lot  of  honey  type  escanples  that  say,  "Por 
Christ's  sake  get  your  act  together  - any  act  will  do."  This, 
in  fact,  cane  up  in  a very  specific  way.  We  once  wrote  down  a 
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gane  theoretic  solution  to  a theatre  level  air  war  which  was  an 
n-state  game  and  we  were  able  to  handle  20  or  30  strategies  on 
both  sides.  We  generalized  that  to  the  full  land  and  air  situa- 
tion. We  ostensibly  could  write  down  the  game  theoretic  solution 
to  any  arbitrary  size  ooitbat  in  those  terms.  The  only  trouble 
was  that  it  resulted  in  an  n-state  game  in  vhich  the  nxmber  of 
strategies  was  any  arbitrary  ntrtoer  of  millions  you  might  imagine. 
There  wasn't  any  way  to  deal  with  that  size  game  matrix.  All 
of  which  was  noted  as  nonsense  anyway  because  in  fact  many  of  the 
natrix  entries  - by  far  the  majority  - were  nonsense  because  they 
were  monstrosities  or  they  were  chaotic  or  they  were  tr ivied  in 
the  sense  that  what  the  infantry  oenpany  did  on  the  left  flank 
was  total  unrelated  to  what  was  hajpening  on  the  right  flank. 

The  only  way  to  try  to  get  at  that,  was  to  recignize  that  things 
weren't  done  that  way.  Each  echelon  in  the  hierarchy  of  aomnand 
makes  general  statements  that  are  modified  on  their  way  down.  I 
kept  hoping  that  you  would  say  sonething  about  the  subject  of 
chaos  and  cooperation.  It  seems  to  me  that  that  is  a whole  new 
perspective  on  the  business.  We've  been  thinking  about  decisiems 
in  a cptimum  decision  sort  of  way.  It  isn't  clear  to  me  but  that 
the  first  name  of  the  game  is  to  get  sane  coherence  and  oohesive- 
ness.  It  doesn't  make  all  that  much  difference  how  optimum  it 
is.  The  optimun  chaotic  solutions  are  so  atrocious  that  if  you 
ootdd  siiiply  pluck  those  out  then  that's  90%  of  the  ocmtiand  and 
control  operation. 

Anderson:  After  Gen  Welch's  Icxig  speech,  I would  like  to  return 
to  your  theme  of  education  in  this  aurea  bec:ause  that  is  a parti- 
cadarly  peirtinent  subject.  At  this  time  COD  has  just  recognized 
the  need  for  specific  educaticxi  in  the  area  of  exmnand,  control 
and  cxrinunication.  One  of  the  things  I am  afraid  of  Icoking  at 
the  evolution  of  this  is  that  as  past  disc:ussions  of  WWMCS  noted, 
the  cxmtunicators  are  the  only  ones  ready  and  willing  to  rush 
forwcurd  with  solutions  and  persenriptions.  Having  looked  at  this 
problem  for  seme  time,  I think  that  the  third  C in  oui^t  to  be 
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a small  c in  coiparison  to  the  other  two.  I would  be  interested 
in  your  ideas  as  to  hew  one  should  go  about  formulating  a cur- 
riculuti  for  this  sort  of  activity  and  getting  the  involvement 
of  seme  of  the  people  who  have  spoken  at  this  conference  and  vvho 
I think  have  seme  ideas  that  ought  to  be  better  assimilated  into 
the  educational  structure. 

Kalaba:  Of  course  we  will  try  to  do  this.  That's  vAiy  I assume  you 
are  only  talking  about  people  vho  already  have  an  I®A  or  seme- 
thing  of  that  sort  and  are  already  well  versed  in  OR  and  such.  I 
think  one  has  to  get  dewn  to  the  nitty  gritty  of  having  people 
vho  are  concerned  with  resipply  or  something  and  vho  really  want 
to  solve  the  problem  and  who  are  really  going  to  be  involved  in 
doing  research  themselves.  They  should  work  right  along  with 
people  in  these  areas.  They  really  have  to  do  the  research 
themselves.  It's  the  spending  of  those  mcxiths,  or  several  years, 
really  doing  an  OR  jeto,  seeing  that  through  frem  beginning  to  end. 
Sipervising  is  not  the  sane  as  doing  it.  Seeing  how  oemputers 
are  usually  out  of  order,  seeing  v*at  kind  of  solution  one  ends 
ip  with  as  cenpared  to  vihat  one  hoped  to  get  in  the  beginning. 

I think  that  that  kind  of  seasoning  is  going  to  make  one  tough 
cookie  to  deal  with  later  on.  I think  we  are  in  real  deep 
trouble  unless  we  have  real  tough  cookies  like  that  who  can 
speak  fran  firsthand  experience.  You  can  be  in  the  Air  Force  all 
you  want,  but  I spend  all  my  time  in  the  ocuputer  laboratory. 

You  can't  really  imagine  v*at  that's  like  and  I can't  imagine 
what  your  situaticai  is  like.  I think  we've  got  to  have  seme  peo- 
ple who  can  do  these  things,  where  you  can't  pull  the  wool  over 
their  eyes  at  all.  I think  the  people  vho  I have  seen  around  here 
are  the  ones  who  ou^t  to  discuss  these  further  plans.  The 
Air  Force,  the  academies  and  private  think  tanks  have  to  share 
the  responsibility  here.  They  have  to  be  represented  in  this 
educational  system. 

Thrall:  We  have  seen  a process  of  moctel  building.  Wb  may 
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decide  to  reject  the  model  or  we  may  decide  to  go  on  and 
i^ether  it's  worth  trying  to  improve  it.  If  it  is,  you  go  on, 
otherwise  you  stop.  If  we  carried  out  that  process,  we'd  never 
be  able  to  use  a model.  I think  you  must  have  sorneplacp  where 
you're  going  to  use  the  model,  even  though  you  may  not  be  oon- 
pletely  theoretically  happy  with  it.  A good  exanple  is  in 
physics.  We've  used  F = ma  for  a good  bit  of  our  terrestrial 
dynamics.  We've  built  our  autcmobiles  with  it,  all  kinds  of 
things.  It  worked  quite  well,  even  though  we  know  we  have  to  put 
in  the  relativistic  correction.  I think  you  have  to  ask  another 
question  at  that  stage.  That  is,  are  the  iitperfections  in  the 
model  such  that  we  can't  even  begin  to  use  it?  At  the  same  time 
that  we  are  continuing  the  research  to  perfect  the  model,  we  also 
have  to  have  sane  sort  of  criterion  as  to  when  we  are  going  to 
use  it.  I think  this  is  where  I have  to  question  Clyde's  state- 
ment. He  said  you  never  get  a model  that  you  will  accept 
scientifically.  But  you  vrouldn't  be  in  the  model  business  if  you 
wouldn't  sonehow  find  a place  where  you  could  use  it.  What  is 
the  criterion  for  usability  of  the  model  as  opposed  to  theoretical 
acceptance  of  the  model? 

Hartley;  It  seems  to  me  that  the  question  of  whether  the  model  is 
good  enoi^h  is  one  of  statistical  efforts  that  arise  in  using  a 
model.  I think  those  statistical  efforts  can  be  measured  and 
translated  into  risks  that  are  involved  in  using  an  approximate 
model.  However,  it  seems  to  me  also  that  even  if  all  this  is 
done,  it  usually  wall  be  found  in  models  in  which  himan  elements 
are  involved,  that  the  model  itself  will  require  a very  large 
rairber  of  variables.  It  all  depends  cn  what  levels  these 
variables  are.  Weapons  systems  are  dependent  on  the  weather  - 
is  there  fog  or  is  there  not  fog-  the  so-called  state  of  the 
wrorld  variables.  If  you  are  planning  for  the  future  and  using 
such  models  involving  a large  rninber  of  variables,  for  many  of 
these  variables  it  is  ooipletely  unknowm  at  which  levels  they 
will  be.  What  are  the  battle  situations  that  you  will  enooimter 
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in  the  future?  You  can  only  make  guesses.  It  turning  back  to 
Dr.  Kalaba's  suggestion  that  there  should  be  a team  of  scientists 
involving  the  law  and  then  evaluating  systems  with  regard  to 
their  merits.  One  system  may  be  very  good  indeed  if  you  make 
certain  assunptions  about  htot  the  state  of  the  world  variables 
will  be  in  the  future  that  you  will  ask  to  encounter.  People  in 
cctipanies  who  want  to  make  a decision  as  to  vAiether  a new  product 
should  be  put  on  the  market  or  not  have  units  called  venture  analy- 
sis. Venture  analysis  people  try  to  do  their  best  to  build  a 
model  to  predict  what  profit  could  be  made  from  such  a new  pro- 
duct. They  have  in  these  models  a large  number  of  state  of  the 
world  variables  that  they  are  not  able  to  predict.  I'Jhat  do  they 
do?  They  present  their  assumptions,  their  model  to  management 
and  it  is  nenagement,  the  real  hi^  ip  people  in  the  cotpany,  who 
make  the  decisions  as  to  the  likelihood  whether  certain  state 
of  the  world  variables  will  be  encountered  or  not  and  at  what 
level.  I mention  what  that  comes  down  to  is  the  hard  core 
decision  maker  is  still  needed  to  make  a judgment  as  to  vhat  is 
the  likelihood  of  certain  situations  that  are  going  to  be 
encountered  by  the  system  in  the  future.  I don't  think  a 
scientist  can  make  a judgment  as  to  what  level  these  unknown 
state  of  the  world  variables,  as  they  are  called  in  model 
building,  will  be  at.  You  need  sanebody  vho  has  a very  good 
judgment  - a political  judgment,  an  econcmic  judgment,  a techn- 
nological  judgment  - as  to  what  the  system  will  encounter. 

Modrick:  I'd  like  to  nake  one  caiment  about  the  relationship 
between  models  and  then  two  or  three  others  that  are  a little 
more  general  but  still  fairly  closely  related  to  the  sort  of 
thing  we  were  trying  to  get  at.  As  far  as  models  are  concerned,  I 
don't  think  we  ever  reject  a model,  I think  we  substitute  coe 
model  for  another.  I think  the  evaluation  of  models  is  largely 
relative.  It's  true  that  we  can  apply  an  absolute  statistical 
criterion  but  when  it  boils  down  to  the  practical  usefulness  of  a 
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mcxtel,  I think  the  statistical  criteria  are  not  really  the  most 
useful  cxies.  They  are  judgmental  and  in  that  sense,  if  model  B 
is  better  than  model  A or  predicts  vtet  we  are  interested  in 
more  successfully  then  we  will  reject  model  A and  begin  using 
model  B.  Certainly  in  the  area  of  psychology,  there  is  a long 
history  of  relatively  bad  models  for  predicting  how  successful 
someone  might  be  in  a particular  job.  They  continue  to  be  used 
until  we  find  a model  that  will  predict  more  successfully.  That's 
point  one.  Point  two  is  that  we've  been  discussing  the  general 
dcitiain  of  models  for  catmand  and  control.  I think  there  is  a 
distinction  that  might  be  made  that  has  occasionally  cropped  up. 
That  is  a model  for  the  decision  maker  as  opjposed  to  a model  for 
the  data  generating  process  or  for  the  environment.  Dr.  Kelly 
described  what  I think  of  as  primarily  a model  for  the  decision 
maker.  His  value  structure,  and  trying  to  represent  in  an  online 
decisicyi  the  utility  structure  that  he  might  use  himself.  An 
aside  with  respect  to  that:  the  way  in  which  Dr.  Kelly  presented 
that  it  was  rejected  fairly  substantially  on  the  grounds  that 
we  don't  want  to  substitute  an  arbitrary  model  for  the  decision 
maker's  decisions.  But,  in  fact,  the  way  such  a model  would 
be  developed,  would  be  to  have  the  oomnander  himself  - and  this 
would  be  unique  to  each  oaimander  - sit  dcwn  with  the  utility 
structure,  do  the  sensitivity  analysis  himself  and  decide  either 
that  he  liked  that  utility  structure  and  the  Bayesian  model 
underlying  the  structure  represented  his  own  point  of  viev. 

Until  he  was  carp  lately  satisfied  that  that  was  representative, 
he  would  be  very  reluctant  to  use  it.  The  point  is,  in  the 
of  model  they  were  trying  to  build,  it  is  possible  to  do  that  in 
advance,  so  that  when  the  actual  online  use  occurs  he  is  in  a 
position  not  to  accept  it  as  if  it  were  gospel  but  to  understand 
what's  behind  it  and  accept  it  as  a representation  of  the  infor- 
mation he  himself  introduced  into  the  model.  In  the  model  Dr. 

Kelly  presented,  there  is  a representation  of  the  state  of  the 
world  in  the  form  of  a set  of  probabilities  and  it's  frcm  that 
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one  fact  that  1 am  referring  to  a model  of  the  environment. 

That  is,  in  defining  the  state  of  the  world,  the  environment 
must  be  represented.  I believe  that  many  of  the  models  that  have 
been  discussed  here  have  been  models  for  the  underlying  data 
generating  process  or  state  of  the  world.  I think  that  is  a 
quite  useful  exercise  and  one  that  is  needed,  perspective  with 
respect  to  that  is  a little  different  than  the  attitude  that  would 
be  typical  of  an  OR  specialist.  Optimization  algorithms  are  fine 
for  presenting  the  reocmmended  solution  but  what  the  coimander 
needs  is  a better  understanding  of  the  underlying  space  in  viAiich 
that  optimization  took  place.  Ihat  is,  he  heeds  to  be  able  him- 
self to  explore  sensitivity  analyses  and  sya,  how  sharp  is  the 
peak  at  that  optimun?  What's  the  effect  on  all  the  numerous 
variables  on  the  shape  of  that  space?  Svppose  I change  various 
ccrponents.  The  way  in  which  a model  of  the  environment  could  be 
quite  effectively  used  is  as  an  educational  process  to  build  in 
the  heads  of  the  decision  maker  a clear  picture  of  the  way  the 
environment  changes,  or  the  impact  of  various  kinds  of  envircxmen- 
tal  cdianges  on  some  kind  of  optimization  process.  I believe  this 
is  a positic*!  that  is  reflected  in  sere  of  the  material  Dr. 

Tolcott  talked  about  and  some  of  the  work  OMR  is  sponsoring, 
vihera,  rather  than  getting  optimal  solutions,  the  display  that 

will  be  provided  to  the  decision  maker  would  be  a display  of  j 

the  space  in  which  that  c^timizaticsi  takes  place.  And  give  him 
a broader  perspective  from  which  to  make  his  am  judgment  rather 
than  making  the  judgment  for  him. 
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A PROPOSED  EDUCATIOgAL  PROGRAM  FOR  COMWJD 
CONTROL  AND  COMMUNICATIONS 


by  DR.  MICHAEL  G.  SOVEREIGN 
Navai  Poitg'Ladaate  School,  Monti>Aetj,  CatL(iO/inLa 


The  priinary  purpose  of  this  workshop  has  been  to  sharpen  the 

research  focus  on  decisions  in  C^.  However,  I believe  that  there 
is  a more  fundamental  problem  which  has  been  identified  during  the 
meeting.  That  problem  is  that  the  operators  of  the  C^  systan  and 
the  designers  of  the  system  are  not  on  the  same  wave  length.  This 
open  switch  makes  it  difficult  for  researchers  in  the  information 
and  decision  sciences  to  even  get  into  the  loop.  I would  maintain 
that  this  problem  is  one  of  education  or  lack  thereof.  Professor 
Bob  Kalaba  of  USC  has  apparently  reached  a similar  conclusion. 
Lieutenant  General  Creech  of  the  Electronics  Systems  Caimand  iden- 
tified the  problem  on  Thursday  when  he  said  "that  we  need  to 
tighten  up  the  dialogue  between  operators  and  designers,  have  more 
interaction  but  stay  out  of  the  other  sides  work. " We  must  educate 

the  C^  coirmunity  to  distinguish  the  proper  roles  of  the  elements 
of  the  comnunity  and  to  perform  their  own  roles  corpetently.  Rear 
Admiral  Engen  also  said,  "Don't  let  the  system  gorw  like  Topsy 
just  because  ve  have  the  technology."  Rear  Admiral  Kinnear  added 
that  v>e  must  get  articulation  of  what  the  operators  want  in  order 
to  affect  decisions.  These  statements  all  point  to  the  need  for  a 
more  thorough  preparation  for  the  officers  vho  are  the  users  of 
the  national  C^  system  to  enable  them  to  talk  to  the  engineers 
without  telling  the  engineers  how  to  do  the  design.  One  reason 
that  an  educational  program  is  necessary  is  that  the  C^  ccmnunity 
is  not  now  cohesive  or  well-defined.  We  have  heard  several 
speakers  mention  the  sociological  problem.  It  is  difficult  to 
beccme  a C^  professional  if  you  can't  define  it. 
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I would  like  to  establish  the  seriousness  of  this  situatioi 
with  a few  more  quotations  fron  Thursday's  presentations.  Major 
General  Jasper  Welch,  Assistant  Chief  of  Staff  for  Studies  and 
Analysis  said  "at  the  budget  decision  level  is  out  of  control." 
Pear  Admiral  Engen  said  that  the  Navy  has  two  problems  in  C^: 

1)  Operators  don't  participate  in  architectural  planning 
of  the  system. 

2)  Systems  designers  just  plunge  into  tie  hardware  without 
determining  the  needs. 

Professor  Kalaba  said  today,  I believe,  that  ve  need  "encoder's 
and  decoder's"  to  help  the  dialogue.  The  educational  preparation 
of  officers  frcm  all  of  the  services  for  positions  in  the  planning 
of  systems  has  recently  been  under  active  consideration  by  the 
I Director,  Telecommunications  and  Ccmand  and  Control  Systems,  OSO. 

! Although  no  definite  decisions  have  been  made,  a graduate-level 

program  for  officers  at  0-4  and  above  is  under  consideration.  The 
I Naval  Postgraduate  School,  among  others  has  been  asked  to  explore 

the  development  of  a suitcible  curriculum.  I would  like  to  present 
certain  aspects  of  that  curriculum  today  and  get  your  reactions  to 
it. 

The  general  process  for  developing  a curriculum  is  shewn  in 
Figure  1.  The  billet  requirements  are  currently  being  developed 
by  OSD  and  the  joint  ccitmands.  A first  iteration  of  the  skills 

i 

I list  has  been  established  and  is  shown  as  Figtire  2 along  with  a 

; statement  of  a general  objective.  The  Naval  Postgraduate  School 

is  currently  developing  a curriculum  conception  response  to  this 
requirement.  This  curriculum  will,  by  necessity,  be  influenced  by 
the  related  existing  curricula  at  the  Naval  Postgraduate  School. 
These  include  those  of  Figure  3.  For  exaiiple,  an  existing  curri- 
culian  in  ocmnunications  with  approximately  40  students  currently 
on  board  is  shewn  as  Figure  4.  Hex^ver,  an  inportant  departure  in 

O 

the  new  preposed  curriculum  in  C is  the  aiphasis  on  operational 
capability  and  the  ability  to  think  of  inprovanents  in  as 
related  to  their  contribution  to  military  effectiveness.  The 
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FIGURE  2 

COMMAND,  COtffROL  AND  COMMUNICATIONS  SYSTEMS  CURRICULUM 


OBJECTIVE:  To  provide  officers,  through  graduate  education,  with 
a ccitprehensive  operational  and  technical  understand- 
ing in  the  field  of  cotmand,  control  and  catinunica- 
tions  systems  as  applied  to  joint  and  canbined  mili- 
tary operations  at  the  national  and  unified  ccrtmand 
levels.  These  officers  will  be  able  to  undertake  a 
wide  range  of  joint  assignments  in  C^  over  full  span 
of  a career. 

EDUCATION  SKILL  REQUIREMENTS 
(C  - Ccrpetency  — U - Understanding) 

. Apply  operational  experience  and  analytical  methods  in  speci- 


fication and  evaluation  of  C^  systems. 

Ability  to  identify  and  articulate  joint  C^  requirements. 
Ability  to  use  lessons  of  past  events  in  planning  opera- 
tions, exercises  and  operational  tests. 

Ability  to  evaluate  applied  operational  research  to  deter- 


mine the  requirements  for  systems. 


Understanding  of  physical  and  analytical  principles  of 
,3 


existing  or  planned  C systems. 

Understanding  of  national  level  operational  decision-making 
processes. 


Understanding  of  the  role  and  behavior  of  the  human  in 
,3 


C systems. 

Ability  to  develop  joint  C^  systaits  plans,  policy  and 
requirements. 

Ability  to  manage  C^  operations,  including  an  understand- 
ing of  ADP  software  management. 

Possess  understanding  of  DOD  and  the  joint  cotmand  struc- 
ture and  National  Security  Affairs. 


Possess  understanding  of  Defense  acquisition  processes. 
Ability  to  adapt  C^  system  design  and  operations  to 


U 
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electronic  and  physical  vulnerabilities. 
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Possess  understanding  of  and  intelligence,  logistics, 
management  information  systems  relationships  and  inter- 
operations. 


REIiVANT 


FIGURE  3 

NAVAL  POSTGRADUATE  SCHOOL  CURRICULA 
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OPS  RESEARCH/SYSTENS  ANALYSIS 
COMPUTER  SYSTEMS 
COMPUTER  SCIENCE 
METEOROLOGY 
OCEANOGRAPHY 
ANTI-SUBMARINE  WARFATiE 
WEAPONS  SYSTEMS  TECHNOLOGY 
WEAPONS  SYSTEMS  SCIENCE 
UNDERWATER  ACOUSTICS 
NAVAL  ENGINEERING 
ENGINEERING  ELECTRONICS 
COPMUNICATICNS  EHGj.eEERING 
AERONAUTICAL  ENGINEERING 
TELEraWNICATIONS  SYSTEMS 
NATIONAL  SECURITY  AFFAIRS 
SYSTEMS  ACQUISITION  MANAGEMENT 
NAVTU^  INTELLIGENCE 
ADMINISTRATIVE  SCIENCE/MANAGEMENT 
ELECTRONIC  WARFARE 
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FIGURE  4 


COMUNICATICNS  ENGINEERINGAELECXM4LINICM’ICWS  SYSTEMS 


Curricula  Ccniponents 


Electrical 

Eiigineering 


Ccrrnunications 


Information  Processing/ 
Systems 


Organization  & 
Management 


Electrical  Engineering  Fundamentals 
Pulse  & Digital  Circuits 
Microwave  Devices 
Electrcmagnetic  Engineering 
Mvanced  Network  Theory 
Advanced  Systems  Engineering 

Ccftmunications  Technology 
Electrcmagnetic  Cotpatibility 
Advanced  Digital  Methods  in 
Ccrmunications  Systems 
Ccmnunications  Satellite  Systems 
Engineering 

Ccrmunications  Systems  Analysis 
Radio  Propagation 

Introducticxi  to  CCitputers  & COBOL 
Progranming 

Real  Tims  Information  Systans 
Real  Time  Information  Systems  Mgmt. 

Defense  Teleconnunications 
Organization  and  Planning 
Integrated  Defense  Teleocnmunications 
Systems 

Introduction  to  Systans  Acquisition 

^^mt. 

Defense  Resource  Allocation 
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importance  of  this  capability  has  been  enphasized  at  this  workshop. 
Dr.  Bonder  has  described  the  current  state-of-the-art  of  combat 
modeling.  In  my  opinion  the  state-of-the-art  will  not  support 
detailed  analysis  of  systems;  however,  there  is  premise  for 
the  future  and  the  proposed  program  will  have  a heavy  aiphasis  in 
what  I would  term  operations  analysis  in  the  classical  sense,  the 
central  pillar  in  Figure  5.  The  officer  must  be  a specialist 
above  all  in  military  operations.  Requirements  for  intelligence 
information  or  ccmmunicaticais  must  ultimately  flow  froti  the  mili- 
tary operation (s)  they  are  supporting  or  could  support.  Informa- 
tion, as  General  Welch  pointed  out,  is  useless  unless  it  can 
affect  what  the  catmander  would  do.  Secondly,  if  the  planner 
knews  what  the  oporaticxial  requirements  are,  he  must  next  be  able 
to  model  the  performance  of  the  system  to  see  if  it  can  support 
the  requirement.  Rigorous  model- building  skills  are  required  if 
we  wish  to  avoid  the  long  debates  such  as  that  between  Dr.  Saaty 
and  Professor  Coanbs.  This  requires  skills  in  analysis  and  an 
understanding  of  the  technology  of  cotmunications  and  cenputers, 
including  the  electronic  warfare  vulnerabilities  that  were  aipha- 
sized  in  this  meeting  by  General  Creech.  Finally,  the  planner 
must  be  able  to  ccmunicate  his  analysis  of  the  requirement  in 
quantitative  performance  in  functional  terms  that  are  meaningful 
to  the  design  engineer.  The  IBM  study  of  future  WWNCCS  architec- 
ture discussed  Yr.-ce  is  a prime  exanple  of  effort  in  vhich  this 
type  of  officer  /ill  be  called  upon  to  piarticipiate. 

A sp)ecialist  of  the  type  we  are  trying  to  develcp  has  a 
legitimate  function  in  increasirq  the  DCO  capability  of  "crisis 
management,"  a term  heard  often  at  this  meeting.  With  his  empha- 
sis on  thinking  of  what  information  is  useful  to  the  military 
oenmander,  he  should  be  able  to  plan  better  for  surge  cap)ability, 
failures,  vulnerabilities,  informaticffi  overloads,  etc.,  that  will 
occur  in  a crisis.  However,  that  is  still  a planning  function  not 
"crisis  management"  per  se.  At  best  ws  can  hope  that  a trained 
officer  at  the  higher  levels  will  realize  that  no  system  can 
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provide  centralized  management  and  control  of  all  the  details  for 
decision  makers  at  every  level  once  the  situation  deteriorates 
from  crisis  to  canbat.  If  the  trained  officer  can  resist  insert- 
ing hijnself  into  such  a position  or  convince  his  boss  of  tte 
necessity  to  delegate  downvsiard,  he  will  have  made  a great  contri- 
bution to  our  capability  to  manage  within  our  system. 

The  proposed  curriculum  would  cover  the  general  topics  shown 
in  Figure  6.  The  particiHar  courses  which  would  becone  the 
vehicles  for  these  tc^ics  have  not  yet  been  worked  out.  I en- 
courage everyone  with  a stake  in  the  area  to  consider  the 
educational  problem  cind  give  us  the  benefits  of  their  thoughts 
on  the  proposal. 
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FIGURE  6 


POTEMTIAL  CURRICULUM  COMPCNEMTS 

Operations  Analysis 

Operaticais  Planning 

Analytical  tools,  modeling,  gaming 
easures  of  effectiveness,  risk  analysis 
DOD/  Joint  Planning  Systems  (e.g. , JOPS) 

Operations  Control/Execution 

^teasures  of  force  availability  & readiness 
Decision  analysis  - risk  measurement 
Critical  intelligence/ccmnunications  parameters 
WWWXS  hardware,  software,  capabilities  & limitations 
Operations  Evaluation 
Damage  assessment 

Measuranent  & statistics 
Real-time  information  requiranents 
Case  studies  of  past  operations 
Connunications  Engineering 

Circuits,  signals,  and  propagation 

Ccmnunications  technology  including  satellite  systems 
Signal  security  & exploitation 
Operational  factors:  oonpatibility,  systans 
interference,  switching  concepts 
Conputer/Information  Processing 

Software,  including  compilers  & operating  systans 
Interactive  query  systans  & information  structures 
Integration  of  computer  information  systems 
Ccrputer  graphics  and  signal  processing 

Man-machine  interface  for  computer-assisted  problan  solving 
Real-time  infomation  systems 
Management 

Defense  teleccmnunications  orgainization  and  planning 
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BRIEF  REMARKS  ON  THE  WORKSHOP 


by  TERRY  J.  liRGNER 
UniveAi-Lty  Texcu 


Before  making  sane  general  cxitments  on  the  workshop  let  ne 
begin  by  stating  that  my  backgrourKl  is  that  of  an  electrical 
engineering  professor  primarily  interested  in  the  applications  of 
probability  theory  and  statistics.  My  current  interests  are  non- 
parametric  discriminatioi  and  estimation  and,  vAiile  these  interests 
certainly  are  relevant  to  many  specific  military  problems,  they 
play  no  major  role  in  tactical  conmand  and  control  prctolems.  I 
should,  then,  in  no  way  be  considered  a technical  expert  in  the 
area  to  which  this  workshop  is  directed. 

Aside  fron  forming  the  obvious  picture  of  a coimander  in  the 
field  being  overloaded  with  informaticxi  in  combat  situations,  I 
got  little  in  the  way  of  specific  information  frcm  the  presenta- 
ticMis  about  tactical  command  and  control  problems.  This  is  not 
meant  to  be  a criticisn  since,  for  exanple,  most  of  the  high- 
ranking  officers  probably  viewed  their  presentations  as  mainly 
sensitizing  the  technical  cannunity  to  a situation  that  is  a cur- 
rent major  military  concern.  However,  if  people  like  nyself  are 
expected  to  be  working  on  mathematical  prdolems  which  are  relevant 
to  this  area,  there  has  to  be  a mechanisn  vAiere  we  can  really  get 
into  these  problems  bo  the  point  of  being  able  to  extract  useful 
models.  The  workshop  did  not  do  this. 

As  for  the  presentations,  I found  many  of  the  technical  talks 
of  the  first  two  days  fairly  tangential.  For  exanple,  it's  hard 
to  imagine  how  the  classification  and  categorization  of  all  types 
of  systems,  living  or  otherwise,  is  ever  going  to  have  any  inpact 
on  what  cin  admiral  does  with  his  fleet  in  an  engaganent  at  sea. 
Beyond  this,  there  were  several  talks  that  left  me  disturbed  to 
various  degrees.  They  all  shared  a common  characteristic:  a 


J 


I 


531 


ccmplex  situation  was  oversinplified  with  an  inappropriate  model. 
For  escanple,  the  thought  that  soneone  would  actually  build  a sys- 
tem showing  a "bug"  on  a triangle  moving  around  toward  decision 
apexes  astounds  me.  For  one  thing,  the  Bayesian  decision  theore- 
tic model  discussed  to  arrive  at  the  bug's  movement  seems  totally 
inappropriate  and,  for  another,  this  "bug"  system  has  gone  beyond 
vdiat  is  vsnted,  a useful  presentation  of  avialable  information, 
not  a decision  for  a ship  captain.  My  guess  is  that,  in  a real 
situation,  Admiral  Kinnear  would  just  as  soon  throw  the  thing 
overboard  as  let  this  bug  make  his  decisicao. 


REMARKS  ON  THE  WORKSHOP 


by  JESSE  ORLANSKY 


The  meeting  at  Airlie  House  was  outstanding  in  bringing  to- 
gether the  largest  possible  ccrmunity  ccncemed  with  tactical 
ccrtnand  and  ccntrol.  I contend  you  on  it,  especially  with  regard 
to  senior  military  personnel  one  of  i4icni,  probably  the  brightest, 
stayed  through  the  entire  meeting.  Gctnmand  and  control  is  an 
unusual  area  of  technology  and  is  among  the  last  to  develop  a 
clear  technology  base.  The  magnitude  of  the  RDT&E  efforts  assign- 
ed to  cortitiand  and  control  is  not  well  known.  It  is  an  area  in 
vrfiich  the  senior  military  officer  is  not  only  the  prime  custcmer, 
as  in  all  fields,  but  the  final  judge  of  effectiveness  and  a very 
significant  contributor  to  the  technology  of  carmand  itself.  Con- 
mand  is  the  main  assignment  towards  vAiich  all  military  training  is 
directed.  Of  course  the  military  ara  also  the  final  judges  in 
most  other  areas  of  technology  too.  But  in  most  other  fields,  for 
example,  non-^nilitary  personnel  can  demonstrate  that  a particular 
airplane  flies  faster  or  carries  more  cargo  ard  that's  not  further 
debatable.  In  cotrtand  and  control,  however,  there  is  new  no  other 
last  word,  besides  military  testimony,  as  to  the  effectiveness  and 
acceptability  of  a ccnitiand  system.  In  this  respect,  I'm  overlook- 
ing, of  course,  seme  particular  technologies  inherent  in  sys- 
tans,  such  as  ADP  and  cemtunicatiens,  viiiich  are  directly  measur- 
able. In  my  view,  hewever,  these  are  necessary  but  not  sufficient 
means  for  effective  carmand  and  control,  vihich  must  include  the 
cenmander  and  his  role  in  management,  system  structure,  informa- 
tion input  and  decision  itiaking.  So  much,  then,  for  the  importance 
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It  seems  to  me  that  the  value  of  the  neeting  will  be  lost 
unless  there  is  a rapid  follow-up  on  several  ideas  v^iich  became 
obvious  there.  They  are  not  necessarily  unique  to  ite. 

There  is  a need  for  a taxonany  of  ccmrand  and  control  so 
that  any  one  who  works  on  the  field  can  better  understand  how  his 
efforts  might  relate  to  those  of  others.  Your  meeting  correctly 
brought  together  various  talents  in  ADP,  decision  making,  model- 
ling, connunications,  costing  and  requircanents  with  an  occasional 
philosopher,  psychiatrist,  historian,  mathematician  and  general 
systans  theoretician.  This  might  encourage  all  to  understand 
vrfiere  they  might  contribute  and  a few  to  leave  the  field.  At  the 
monent,  this  taxonomy  need  only  be  a pragmatic  one  subject  to 
change  as  we  learn  more  about  caimand  and  control.  Preferably, 
it  should  be  a simple  one.  Its  structure  should  accomtiodate  prob- 
lems faced  by  all  services  and  the  JCS  at  the  tactical,  strategic, 
crisis  and  routine  (day-to-day)  levels.  The  taxonomy  should  be 
evaluated,  as  vrell  as  illustrated,  by  examining  how  it  would 
handle  a selected  sanple  of  crises  and  wars.  It  nay  be  that  a 
usable  taxonomy  already  exists  in  the  work  reported  at  the  meeting 
by  IBM  on  the  MJMCCS  architecture  and  perhaps  by  others  in  previ- 
ous studies.  If  so,  I would  suggest  that  such  taxonomies  be  com- 
pared and  a prototype  proposed  for  use  by  the  ROT&E  ccrmunity. 

Major  attention  must  also  be  given  to  measures  of  effective- 
ness of  ccnmand  and  ccxitrol  systems . In  fact , the  taxorcmy  sug- 
gested above  should  provide  the  structure  for  identifyir.g  relevant 
measures  of  effectiveness  at  various  levels  in  systoriB  It 
may  turn  out  that  ve  need  many  different  types  of  neasures  of 
effectiveness.  In  this  case,  a catalog  is  useful  for  denonstra- 
ting  that  any  sub-set  of  measures  concerns  only  some  of  the  rele- 
vant criteria. 

Given  sane  performance  measures,  it  would  be  of  considerable 
interest  to  coipare  what  they  may  tell  us  in  reviews  of  the  same 
events  as  seen  in  simulations,  exercises,  and  the  real  world.  I 
believe  that  there  is  much  to  be  learned  ty  insisting  on  more 
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quantitative  analyses  in  a field  which  has  largely  avoided  them  so 
far.  It  is  also  iiiportant,  of  course,  to  plan  exercises  of  com- 
mand-control systans  in  such  a way  as  to  tell  us  eibout  systat 
readiness  (their  usual  purpose)  and  to  contribute  to  a data  base 
to  support  the  design  and  develcprent  of  iitproved  systans.  I want 
to  enphasize  that  it  is  important  for  R&D  personnel  to  get  involv- 
ed in  the  planning  and  analysis  of  operational  exercises  of  con- 
mand  and  control  systans.  That  particular  gold  mine  has  been 
disregarded  in  a way  that  wuld  be  unacceptable  in  almost  all 
other  fields  where  we  want  to  know  how  things  really  work,  such 
as  flight  testing  of  aircraft  and  missiles,  and  field  trials  of 
radars,  guns  and  lasers.  There  is  also  need  for  manned  simula- 
tions (for  which  there  are  already  many  installations  used  pri- 
marily for  training)  as  well  as  modelling,  vdrere  performance  mea- 
sures can  be  enployed. 

Reports  on  decision-aiding  research  at  tfie  meeting  led  one  to 
see  a clear  need  for  flexibility  in  design  which  would  permit  suc- 
cessive comianders  to  alter  their  local  ccrmand  and  control  sys- 
tems to  suit  their  cwn  preferences  (presumably  within  limits  set 
by  higher,  lower  and  collateral  ccrmands  wath  which  they  interact) . 

I'm  not  sure  that  personal  preference  should  be  the  last  word  in 
the  design  of  a military  ccrmand  and  control  system  but  there  was 
an  expressed  need  for  such  flexibility.  I suspect  that  we'll  have 
to  IxDnor  such  requests  (or  "requirements")  until  objective  perfor- 
mance measures  can  demonstrate  that  sane  ways  of  doing  business 
are  clearly  more  effective  than  others. 

The  other  issue  clearly  brought  cut  by  the  decision-aiding 
research  is  that  guidance  put  out  by  tlie  black  box  should  be  ad- 
visory rather  than  prescriptive.  It  is  a curious  fact  that  all  i 

researchers  say  that  their  systans  offer  only  advice  although  the  i 

cutcones  appear  clearly  as  recotmendations  to  the  users.  In  addi-  | 

tion  to  requiring  all  catmanders  to  read  the  fine  print  on  their  j 

consoles,  I believe  the  only  practical  solution  is  to  provide  a j 

few  big  red  )cnobs  so  that  each  ccrmander  )cncws  that  he  must  enter  j 
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his  own  utility  functions,  without  vAiich  the  scope  would  not 
light  up.  Maybe,  as  in  sane  pocket  calculators,  the  lights 
should  go  out  if  new  instructions  are  not  provided  fron  time  to 
time. 

Finally,  I siiggest  that  you  could  serve  the  Air  Force  very 
well  by  providing  a quick  sumnary  of  the  types  of  RDT&E  suggested 
by  the  meeting.  Although  a sunitHry  of  the  meeting  can  come  out 
later,  plans  for  RDT&E  can  be  made  inmediately  and,  in  any  case, 
take  a long  time  before  they  can  take  effect.  My  own  suggestions 
for  sane  RDT&E  are  the  subjects  of  the  various  paragraphs  above. 
In  addition,  I suggest  a series  of  workshops,  also  taking  place 
soon,  to  develop  the  various  ideas  you  collect  about  what  might 
be  done  to  improve  ccmnand  and  control,  point  is,  of  course, 
that  you  should  almost  iitmediately  continue  the  efforts  that 
such  a fine  start  at  Air lie. 


SOME  OBSERVOTIOJS  BASED  ON  THE 
CONDUCT  OF  THE  WORKSHOP 
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by  JOHN  T.  DOCKERY 
US  AAmy  Concepts  Analysts  Agency 


1.0  JntM.0 duetto n.  it  was  ny  original  intent  to  address  only  the 
general  question  of  effectiveness  measures  in  the  context  of  these 
proceedings.  As  the  workshop  has  developed,  the  applicability  of 
these  prepjared  remarks  has  receded  sotEvdxat  because  the  general 
question  of  measures  of  effectiveness  (MOE)  has  not  been  illumi- 
nated. Therefore,  I shall  address  three  elements  which  I perceive 
as  relating  to  the  definition  of  problem  areas  emerging  from  this 
workshop.  The  first  will  be  an  outline  of  an  approach  which  may 
help  organize  the  subject  of  effectiveness  measures  through  eluci- 
dation of  proper  definitions.  The  second  will  be  in  the  nature  of 
a case  history.  The  third  is  a look  at  catmand  and  control  fran 
an  historical  perspective. 

I will  not  cctitnent  further  on  the  conduct  of  the  foregoing 
sessions  except  to  second  the  general  remakrs  of  both  Dr.  Bonder 
and  Dr.  Bracken.  In  cpting  to  present  three  elements  in  short 
order,  I believe  I am  in  the  spirint  of  a workshop.  They  corre- 
spond to  a canonical  presentation  on  a technical  subject  MDE, 
prepared  in  advance  in  ny  role  as  an  opserations  research  analyst; 
to  a story  telling  role  in  presenting  a fable  in  ny  role  as  a 
panel  guru;  and  in  the  presentatiem  of  seme  half-baked  ideas  on 
an  historical  perspective  in  ny  role  as  a workshop  matter  with  a 
cloistered  foran. 

2.0  Effectiveness  MeasuA.es.  Armed  Services  analysis  of  coiplex 

* These  remarks  have  been  edited  frem  the  actual  presentation. 

The  viewra  expressed  are  those  of  the  author,  and  may  not  reflect 
the  view®  of  the  US  Anty.  In  the  spirit  of  a workshop  the  re- 
marks may  be  couched  in  a manner  intended  to  provoke  discussion. 
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systcans,  to  include  bctli  the  subject  of  weeipon  mix  and  the  subject 
of  ccnnand  and  control  (C/C)  of  such  mixes,  is  faced  with  a dile- 
mna  of  major  proportions.  Although  conventional  wisdom  retreats 
in  the  face  of  the  conundnjn  that  one  cannot  ccnpare  apples  and 
oranges,  it  is  precisely  this  cotparison  which  any  theory  of  C/C 
must  address.  Hew  then  is  one  to  formulate  MS:  caisonant  with 
these  forced  cerparisons? 

One  is  ccnpelled  to  address  the  question  of  mix  conparison 
by  looJcing  for  direction  outside  the  system  in  question.  In 
general  one  can  treat  the  mix  problem  in  terms  of  goal-see)<ing 
systems.  The  coiparison  then  becones  externalized  in  terms  of 
the  efficacy  of  the  various  combinations  in  achieving  the  stated 
external  goals.  This,  it  seems  to  me,  is  the  proper  framework 
for  C/C  analysis.  Failure  to  look  externally  leads  to  MOE  related 
cxily  to  internal  systan  efficiency.  This  in  turn  usually  relates 
only  to  questitxis  of  equipment  efficiency. 

In  cases  of  conflict  there  is  no  means  of  resolution  internal 
to  the  systan.  From  the  tenor  of  discussicxis,  which  we  have  heard, 
it  appears  that  asp)ects  of  the  control  function  are  not  being 
effectively  carried  out.  Sane  MDE  related  to  the  control  function 
would  be  useful  in  quantifying  it.  Perhaps  then  the  nature  of 
our  unease  could  be  measured.  It  is  conventional  to  construct  an 
"ad  hoc"  list  of  candidate  M3E.  This  procedure  has  been  effective 
as  long  as  one  MDE  was  adequate.  Trouble  develops  vAien  MDE  are  in 
conflict. 

In  order  to  conduct  analyses  internal  to  ray  agency,  I have 
searched  for  a proper  exposition  of  MC®  which  would  incorporate 
goal  seeking  features.  In  my  search  of  the  literature  I found 
no  acceptable  raathanatical  definition  of  the  ICE.  The  sole  excep- 
tion was  an  unpublished  work  of  a Mr.  Bitter,  formerly  of  the  US 
Army  Combat  Development  Command  (now  defunct) . In  his  work.  Bitter 
explored  the  possibility  that  MDE  may  ciiey  group  properties.  In 
1973  Pugh  and  Ma>herry  discussed  a tlieory  of  Ma:  but  did  not 
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directly  address  the  question  of  a def initial.* 

Lacking  any  mathematical  definition,  it  is  now  clear  \diy  MOE 
may  be  made  to  perform  almost  any  kind  of  magic  desired.  They  can 
exist  outside  the  normal  rules  of  analysis.  More  amazing  to  me 
has  been  the  dawning  recilization  that  the  total  absence  of  any 
definition  has  been  of  no  great  concern  to  the  caimunity.  Inves- 
tigating this  observation  I am  led  to  conclusion  that  the  absence 
has  been  acceptable  because  analysis  has  rarely  involved  more  than 
a single  WS;.  Since  a chosen  MOE  was  not  combined  in  any  way  with 
other  M®,  the  question  of  its  mathematical  parentage  could  be 
ignored,  although  not  always  with  predictable  results.  As  long  as 
the  subject  under  investigatioi  was  familiar,  an  enpirically  de- 
duced MOE  sufficed.  As  subjects  vere  undertaken  vrfiich  were  more 
ccnplex  and  less  well  understood,  the  selection  of  MOE  on  sane 
intuitive  basis  faltered.  The  now  widespread  practice  of  a priori 
selection  of  an  MOE  has  destroyed  the  link  with  enpirician  com- 
pletely. Rather  than  reveal  inherent  structure,  such  selection 
iirposes  external  structure. 

As  an  indication  of  protolems  vhich  can  arise  in  naive  combi- 
nations of  MOE  I refer  you  to  the  talk  of  Dr.  Coombs,  vherein  he 
eitphasized  the  fact  that  risk  is  not  additive.  Analagous  problems 
occur  in  combination  of  MOE  vtere  they  are  most  often  treated 
siitply  as  real  numbers.  I do  not  believe  this  to  be  true  except 
in  very  special  circanstances.  In  particular  I have  focused  on 
two  aspects  of  W®. 

(1)  They  always  iitply  sane  rank  order. 

(2)  They  usually  reflect  hidden  structure  of  the  problan. 

I am  developing  a definition  of  the  MOE  vhich  defines  than  in 
terms  of  a modelling  process. 

. Define  a set  M with  at  least  a partial  order  on  its 
elements. 

. Define  a set  of  goals  G vdiich  cein  be  related  to  elements 

* OPS  Res  21,  867  (1973) . 


i 


539 


of  set  M by  sane  mapping  p:G  ->■  M. 

The  elements  of  set  M are  said  to  be  effectiveness  measures  if 
they  can  induce  a rank-ordering  on  the  original  goal  set  G via 
sane  m^ing  f:M  -*■  G.  (There  may  exist  additional  sets  and 

mappings  f^^  vdiich  induce  conflicting  goals.) 

Sets  M Sr  G together  vdth  the  transformations  p & f are  then 
a model  of  the  decision  process.  The  "models"  should  then  form 
a category  as  suggested  by  Mesarovic  in  his  text  on  General  Sys- 
tans  Theory.* 

Graphically,  we  have  the  following  in  Figure  1.  The  analy- 
sis problem 


* Mesarovic,  M.  D.  Si  Takahara,  Y. , General  Systans  Theory;  Math- 
ematical Foundations,  Acadanic  Press,  1975,  rhap  XII. 
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with  multiple  MDE  is  the  reconciliaticn  of  the  various  orderings 
(G,  Gj^,  ...)  of  the  original  goal  set  G.  It  is  my  initial  inten- 
tion to  examine  the  prcperties  of  m^s  g:G  ->■  G'  and  -*■  G' 

viiere  G'  is  assumed  to  be  G x G^^. 

By  inplicaticm  the  MCE  is  new  anything  as  long  as  it  induces 
a rankordering  into  goals  associated  with  the  decision  process. 

To  study  ccnputational  properties  of  MDE,  various  kinds  of  sets 
can  then  be  hypothesized  and  the  corresponding  algebra  examined 
and  studied  by  cerparing  the  results  with  known  MDE  results. 
Interesting  sets  of  MDE  can  be  constructed  under  the  conditions 
that  the  postulated  sets,  M,  form  a lattice.  The  lattice  algebra 
then  introduces  the  nax-min  eperations  and  idenpotency  into  cem- 
putaticxis  among  MDE  values.  Relations,  rather  than  functions, 
become  the  proper  expressions  for  inter-relating  different  sets 
of  MC®.  Another  interesting  set  of  MDE  can  be  constructed  using 
fuzzy  set  axioms. 

Time  does  not  permit  a more  formal  and  catplete  development 
of  these  ideas  in  this  forum.  The  essential  thrust  is  to  seek 
an  understanding  and  definition  for  the  concept  of  an  MDE  in  a 
set  theoretic  approach.  Although  abstract,  this  approach  is 
proving  particularly  illuminating  not  so  much  from  the  standpoint 
of  solving  a particular  protolan  but  rather  in  bounding  the  p»ssible 
solutions  to  a problan.  Moreover,  the  investigator  can  recognize 
the  same  problan  in  a different  context.  Examining  analytical 
approaches  to  C/C  ve  find  that  OR  praxis  fexuses  on  solving  each 
problem  as  if  it  were  sui  generis.  A set-theoretic  approach  seems 
to  offer  seme  means  of  reducing  cxaiplexity  by  recognition  of  a 
analler  nrmber  of  related  problems. 

A premising  avenue  of  investigation  looks  at  uncovering  the 
inherent  structure  of  the  prchlem  to  vhich  the  MDE  are  presumably 
seme  kind  of  indicator.  In  paarticular  there  ^paears  to  be  seme 
kind  of  mplicit  hierarchy  among  MDE  vhich  nay  find  expression  in 
the  identification  of  MDE  as  belonging  to  a variety  of  mathanatical 
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entities  ranging  from  real  numbers  to  semi-groi^s . They  usually 
form  posets  although  poset  axions  can  be  selectively  removed  to 
produce  more  general  rank  orders  vhich  still  correspond  to  "real 
world"  MDE.  As  the  MDE  classif icaticai  is  successively  generalized, 
the  corresponding  MDE  should  became  correspondingly  more  inclusive 
and  representative  of  the  problati  as  a whole,  rather  than  its 
constituents  parts. 

Seme  of  the  areas  of  mathenatics  which  appear  to  bear  on  the 
MDE  question  are  as  follcws: 

a.  Category  theory  for  structure  elucidation  and  problem 
ccirparison,  especially  of  the  modelling  process. 

b.  Fuzzy  set  theory  for  its  postulates  that  seme  data  may 
be  forever  indeterminate  to  sane  degree. 

c.  Honotepy  theory  for  its  insights  into  how  things 
transform  and  how  they  behave  under  general  mapping 
arguments.  Hemotopy  theory  seons  to  have  been  neglected 
in  its  potential  ramification  for  C/C  in  those  instances 
vherein  C/C  can  be  visualized  in  terms  of  maps  which 
carry  orders  fron  one  set  (the  coimander)  to  another 
set  (the  troops) . 

d.  Lattice  theory  for  its  ability  to  handle  relations 
arising  fron  partially  ordered  sets  (posets) . (Order 
relations  are  the  most  cenmon  results  of  various  con- 
mi  ttee  procedures,  and  the  lattice  algebra  is  designed 
to  do  cenputations  on  nimbers  satisfying  order  rela- 
tions. ) 

In  suntnary  then,  an  effort  is  laeing  made  to  identify,  and/or 
define  the  oft-used  artiface  )aiown  as  the  MDE.  It  appears  that  a 
nunber  of  interesting  MDE  are  at  least  lattices  and  fuzzy  sets. 

Now  let  us  change  the  subject  and  become  applications  oriented, 
for  it  is  in  the  context  of  applications  that  MDE  must  be  recog- 
nized and  nanipjulated.  We  look  first  at  the  vrorld  of  cenputer 
based  Army  C/C. 
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3.0  A CcLiz  H-UitoA-i^.  It  may  be  isntructive  to  briefly  discourse 
on  the  history  of  the  Army's  attenpts  to  enter  the  tactical  com- 
puter age  for  insights  into  the  prctoleitis  faced  hy  proponents  of 
total  standarization.  Such  an  incorplete  sketch  follows.  Throt^h 
the  late  1960 's  and  into  the  1970' s,  the  US  Army  identified  vari- 
ous functional  aspects  of  its  tactical  operation  as  candidates  for 
automation.  Some  of  the  more  inportant  were  as  follows: 

a.  TACFIRE  (Tactical  Fire  and  Direction  Control)  for 
artillery; 

b.  TOS  (Tactical  Operating  System)  for  use  by  divisiai  and 
brigade  in  the  conduct  of  battlefield  operations; 

c.  Various  intelligence  conputers  for  use  in  the  tactical 
environment;  and 

d.  TSQ-73  for  use  in  joint  service  air  defense  operations. 

It  mi^t  be  expected  that  a ccnputer-based  C/C  systan  would  some- 
day interconnect  these  machines. 

The  Army  also  had  under  development  the  SAM-D  (now  PATRIOT) 
air  defense  system  which  required  its  own  generation  tactical 
conputer,  and  the  CS^  (Combat  Service  Sipport  Systan)  for  use  in 
rear  area  in  perfoniance  of  logistics  functions. 

Of  the  tactical  systems,  the  TACFIRE  was  the  first  developed. 
A third  generation,  air-cooled  machine,  meeting  field  test  condi- 
tions was  developed  under  contract  by  Litton.  It  was  the  Litton 
L-3050  - later  to  be  type  classified  as  the  AN/GVK-12.  This 
general  purpose,  fixed  point  arithmetic  machine  had  the  capability 
to  expand  the  coimand  set  to  floating  aritlmetic.  It  also  had  a 
variety  of  I/O  devices  designed  for  field  (peration.  A language 
intended  to  be  a subset  of  PL/1,  called  TACPOL,  was  developed. 
Acxxsrding  to  the  terms  of  the  original  contract  the  equipment  was 
to  be  designed  so  that  various  mass-production  techniques  could 
be  invoked  at  various  procuranent  levels  to  reduce  unit  cost.  It 
can  be  argued  that  the  AN/GYK-12  machine,  or  evolutionary  varia- 
tic»;s  of  it,  had  the  potential  for  being  a first  geTieration  catiion 
ccrputer  system  for  all  tactical  uses.  At  issue  were  several 
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hundred  ccmputers. 

7\s  history  was  actually  written,  the  L-3050  is  being  procured 
for  TACFIRE  and  is  cctnpleting  tests  for  TSQ-73.  TOS  and  the 
intelligence  conputers  remain  in  the  future  except  for  datonstra- 
tion  configurations  of  TOS.  Throughout  this  period  of  tactical 
conputer  develcpment  two  management  instruments  were  developed  by 
the  Army  for  control.  One  is  the  Amy  Tactical  Data  Systans 
Coimand.  The  other  is  the  ATAlOOQMAP  (Amy  Tactical  Cotitiand  and 
Control  Master  Plan) . 

The  former  is  concerned  with  all  development  aspects  of 
hardware  and  software  for  tactical  uses.  It  has  headquarters  at 
Ft.  Monmouth,  New  Jersey,  heme  of  the  US  Army  Electronics  Cottmand. 
The  other  instrument,  the  ATACCQMAP,  is  basically  a coimittee 
structure  vdiich  oversees  the  periodic  ipdate  of  the  Master  Plan. 
Elements  in  the  plan  include,  or  have  included,  the  following 
study  efforts: 

a.  CONOPS  - Continuity  of  Operations  - (a  control  study) . 

b.  EAD  - Echelons  Above  Division  - (a  cermand  structure 
study) . 

c.  SYSCON  - Ccmnunication  Plan  - (a  conmunication  study) . 

d.  COMSR  - Ccmmunications  Support  Requirements  Study  - 
(a  ccmnunications  study) . 

e.  INTEROP  - Interoperability  of  Systems  - (a  ccmunications 
and  control  stuefy) . 

f.  CEATOS  - A cost  effectiveness  of  the  TOS  - (a  cemand  and 
control  study) - 

g.  IBCS  (now  TCC)  - Integrated  Battlefield  Control  System  - 
(a  control  study) . 

h.  INTACS  - Integrated  Tactical  Ccitinnications  System  (a 
ccnrunications  emd  cdirand  study) . 

Inter-service  efforts  are  mcaiitored  as  well. 

Although  sane  liberty  has  been  taken  in  assigning  a particu- 
lar study  to  one,  or  more,  of  the  three  C's,  the  overall  conclu- 
sicai  must  be  one  of  extoisive  effort  on  all  phases  of  the  C/C 
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problan.  There  is  no  lack  of  MOE  spread  across  all  these  projects.  j 

Problems  arise  Oien  trying  to  draw  conclusions  across  study  lines  i 

using  MOE  developed  for  detailed  individual  studies.  | 

Returning  to  question  of  the  AN/GYK-12,  we  can  perhaps  ex-  ! 

tract  some  lessons: 

a.  The  devlopment  process  is  so  long  and  slow;  cotputer 

evolution,  so  rapid;  that  the  users  becane  disenchanted  j 

with  machines  under  construction  (in  comparison  with  | 

more  recent  prototypes)  long  before  machines  can  be 
type  classified. 

b.  Mass  buys  of  complex  systems,  despite  the  well  known  cost 
learning  curves  benefits,  are  rarely  possible. 

c.  C/C  operatiois  which  have  either  a sani-autcmatic  nature, 
or  follow  a fixed  algorithm,  or  require  extensive  compu- 
tation (e.g. , nuclear  fire  planning)  can  )De  successfully 
fielded.  (TACFIRE  and  TSQ-73  are  exanples) . 

d.  The  utility  of  the  cdtputer  to  more  directly  influence 
the  battle  is  a slow  process  of  definition  which  must 

be  conducted  with  trial  config\xrations  in  field  exercises 
as  wall  as  in  the  laboratory. 

It  may  be  that  unless  the  selection  process  is  greatly  accel- 
erated, and  the  develcpment  of  corputers  reaches  sore  kind  of 
plateau,  the  desired  level  of  total  standardization  is  not  possible. 

If  this  perception  has  any  validity  a rather  different  viewpoint 
is  necessary.  In  this  regard  it  might  be  instructive  to  ccnpare 
the  development  of  telephone  networking.  Very  standardized  equip- 
ment in  t)ie  pre-electronic  days  of  cross  loar  switching  is  to  be 
contrasted  with  current  difficulty  in  making  available  the  kinds 
of  improvements  and  reductions  in  equipment  size  which  electronics 
makes  possible.  There  is  an  arguable  viewpoint  which  accepjts 
inherent  conplexity,  and  directs  itself  to  measuring  systCTis  para- 
meters which  take  into  account  a great  diversity  of  equipment  and 
procedures.  Such  a system  viewpoint  is  not  irherently  inpossible. 

It  usually  is  not  objectively  examined  for  possible  benefits.  Fbr 
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example,  vrfiat  is  the  trade-off  that  may  be  offered  by  the  large 
number  of  canbinations  of  pathways  versus  the  probability  of 
major  conponent  failure  in  a uniform  system? 

In  sunmary  then,  the  c’lltural  matrix,  in  which  the  decisions 
leading  to  existing  C/C  systems  together  with  the  rapid  pace  of 
technology,  may  be  such  that  a totally  standardized  system  is  not 
possible.  Fundamentfil  control  of  the  C/C  function  may  be  through 
a coimittee  structure  which  processes  ccrplex  input  in  the  absence 
of  any  theory  of  C/C.  Ccnmittees  need  measures  of  total  systan 
performance  rather  than  masses  of  detailed  data  in  reaching  their 
decisions. 

4.0  A Mattel-  oj  PeMp&ctive.  Having  becote  confounded  by  the 
ccmplexity  of  the  currently  operating  (and  proposed)  C/C  systems, 

I have  sought  to  extricate  ityself  by  escaping  backward  in  time  to 
sane  previous  epoch.  Can  I find  an  era  vhich  was  perhaps  better 
understood,  or  vhich  is  capable  of  better  understanding?  In  the 
search  I asked  myself  the  follcwing  question.  Is  this  the  best 
of  all  possible  C/C  vrorlds?  Was  there  seme  time  in  the  past  vAien 
C/C  hung  together  better  than  it  does  new?  In  order  words,  was 
there  a time  past  when  all  the  elements  of  C/C  were  present  in  a 
more  ccmplete  form  than  today? 

In  such  a halcyon  time  there  would  not  only  have  been  cotplete 
information,  but  excellent  portrayal  as  veil.  A first  analog  that 
rjggests  itself  is  the  World  War  II  Cotmand  Centers  in  vAiich  ships 
and  planes  were  represented  by  actual  models  novin^  across  a large 
map.  This  is  a kind  of  real  time  information  display.  It  tends 
to  replicate  the  situation  pertaining  when  a conmander  sat  on  a 
nilltop  with  a spyglass  and  dispatched  riders  to  the  force  in 
view.  Let  us  reflect  on  this  hilltop  for  a manent.  Have  ve  done 
better  by  retreating  further?  All  the  elonents  of  good  C/C  seem 
at  hand.  New  let  us  again  move  forward  in  timt!. 

As  the  size  of  the  battle  eiq>anded  cut  of  sight,  conmunica- 
tions  and  control  broke  dewn.  In  a sense  we  can  think  of  these 
as  extensive  and  intensive  a.spects  of  the  problan.  The  extensive 
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portion  relates  to  the  collection  of  needed  information  beyond 
the  imnediate  senses  of  the  caimander.  The  intensive  aspects  is 
the  volute  of  that  information,  and  the  integration  of  that  infor- 
mation into  a form  suitable  for  real  tine  decision  making.  The 
advent  of  radio  restored  the  extensive  aspect  of  C/C  without 

necessarily  restoring  its  intensive  aspect.  The  proliferation  i 

of  ccmnunications  and  intelligence  links,  and  most  recently  the 
introductioi  of  nunerous  and  diverse  battlefield  sensors,  has 
restored  a proticn  of  the  intensive  aspect,  i’ct  information  was, 

and  is  so  intensive,  that  the  senses  are  overwhelmed.  The  prcb-  i 

lem  then  beccmes  one  of  display  and  presentation  capable  of 
restoring  an  integrated  picture. 

The  problem  has  a reciprocal  element  as  well . It  is  addressed 
to  the  control  of  the  forces.  It  is  unquestionable  that  the  per- 
sonal charisna  of  tl*e  ccmmander  was  a vital  element  in  the  execu-  ‘ 

tion  of  orders.  As  the  caimander  receded  fron  view  so  did  the 
chariana.  As  caimunicaticfis  were  gradually  upgraded,  the  written 
content  of  the  messages  got  through,  but  not  always  the  aura  of 
cotmand.  Verbal  message  traffic  restores  sane  of  the  inrediacy  of 
coimand,  but  there  are  countervailing  tendencies.  Working  to 
dilute  this  psychological  ittmediacy  is  an  increasingly  cotplex 
and  layered  coimand  structure,  awash  with  data. 

The  problem  is  still  not  solved.  There  is  anple  evidence 
that  very  high  echelons  becane  involved  in  local  engagements 
sinply  because  the  physical  equipment  permits  it.  Whether  or 
not  this  is  a surrogate  for  loss  of  effective  overall  control 
might  be  an  interesting  question.  What  is  clear  is  this.  Such 
loss  of  overall  control  is  inplicit  in  such  local  involvement. 

It  seems  that  sane  of  the  testimony  presented  at  the  workshop  is 
bound  up  with  the  inability  of  the  current  C/C  to  transmit  various 
subliminal,  but  apparently  essential,  aspects  of  coimand  down  to 
the  forces,  e.g.,  esprit  de  corps. 
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other  interesting  historical  exercises  might  be  to  test  sane  | 

of  our  theories  on  World  War  I representing  war  as  a steady  state 

phenctvena.  Another  interesting  exercise  is  to  examine  C/C  with  ! 

no  caimunication  or  overt  control.  This  is  the  case  when  policy,  ■ 

preplanned  or  otherwise,  is  the  element  of  control,  in  such  | 

cases  c ^ntrol  is  embedded  in  the  system.  Too  little  time  seans 

to  be  spent  on  constructing  and  understanding  limiting  cases  in  i 

which  one  or  two  of  the  aspects  of  C^  are  eliminated.  In  a | 

sense  the  trench  warfare  of  World  War  I should  be  sane  kind  of  ' 

limiting  case.  j 

1 

A little  anthrcpology  may  also  be  instructive.  Historically  j 

the  pace  of  technical  inprovement  has  been  very  slow  so  that 

organizations  responded  organically  to  changes  through  enpircal  ■ 

trial  and  error.  Thus,  the  Eskimo  culture  represents  thousands  ! 

of  years  of  eitpirical  experimentation  with  all  possible  conbina-  I 

tions  of  resources  and  strategies.  Today,  neither  armies,  nor  i 

cultures,  have  very  much  time  to  respond  to  the  onslaught  of  change  ! 

which  is  now  the  norm.  Moreover,  armies  now  work  toward  preven- 
ting conbat  while  equipping  and  training  for  cembat.  The  result- 
ing chaos  in  the  C/C  is  no  less  real  than  the  resulting  chaos 
when  vastly  inprcved  techniques  are  introduced  into  static  cul- 
tures. Sane  of  the  military  coiplaints  which  I believe  I have  I 

heard  voiced  at  this  workshop  seem  to  have  a familiar  ring:  | 

. Inability  to  cotinunicate  in  the  sense  of  understanding;  ^ 

. Inability  to  cope  with  the  formal  structure; 

. ESocessive  isolaticn  of  the  higher  decision  maker; 

. Unresponsiveness  to  change;  and 
. Failure  to  get  the  message  out. 

Because  the  idea  of  a time  constant  seems  a natural  way  to 
describe  coiplex  time  dependent  physical  phenonena,  and  because 
the  question  of  time  scales  seems  irtportant  to  C/C,  I have 
sane  classes  of  entities  discussed  in  connection  with  C/C  with 

respective  time  scales  for  u^provement  and  some  estinmte  of  | 

current  technical  effort. 


( 

I 
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Equipment  for  C/C 
Procedures  for  C/C 
C/C  Organizations 
C/C  piersonnel 


TIME  SCALE 
Months/Years 
Years 

Years/tiecades 

Months/Years 


CURREWT  TECHNICAL 

DEVEioPMEyrr  effort 
Excessive 
Moderate 
Moderate 
Intensive* 


* Development  in  the  sense  of  training  is  implied. 

I also  note  from  this  workship  that  a considerable  bending 
of  the  hunan  operator  to  fit  equipment  driven  procedures  is  in 
progress. 

I have  also  looked  at  the  kinds  of  organizations  which  have 
C/C  problems,  and  which  might  give  insight  into  the  C/C,  as  well 
as  yield  to  analysis  on  the  basis  of  time  scales.  The  possible 
combinations  are  awesome. 


ORGANIZATION 
Strategic 
Tactical 
Guerilla 
Task  Force 
Police  State 


EACH  MAY  HAVE 

STRUCTURE  CF  C/C 
IN  ORGANIZATION 

Enbedded  in  organization 

Explicit  in  organization 

Centralized  in 
organization 

Distributed  through 
organization 

Default 

Hierarchial 


EACH  MAY  EXIST  IN 


SOME  POSSIBLE 
STATES  OF  ACTIVITY 


Vfar  through  a 
surrogate 


A proper  theory  of  current  C/C  would  distinguish  conbinations 
of  the  foregoing,  as  well  as  spell  out  their  functioning.  In  a 
search  for  techniques  which  will  yield  insight,  I would  have  to 
single  out  artificial  intelligence  (AI)  as  the  area  which  hereto- 
fore has  most  often  cane  to  grips  with  the  kind  of  C/C  prcblons 
unearther  in  the  workshop.  AI  seems  capable  of  addressing  the 


order  of  indiffemece  to  these  two  stateitients,  I come  up  with  the 
following: 

[i  area  "SEm"  "ARE" 

1 1 Cdnnunications  Indifferent  Very  responsive 

Control  Responsive  Responsive 

I Cdmand  Very  responsive  Less  responsive 

I In  regard  to  ccnnand,  I might  note  that  several  speakers  have 

mentioned  the  fact  that  conmanders  will  make  the  same  decision 
[ based  on  a wide  variety  of  information,  scite  of  it  contradictory 

and  conflicting,  when  ccnpared  across  the  various  ccttitanders 
receiving  the  information.  The  message  I am  receiving  is  this. 

[ , The  current  analysis  thrust  must  be  at  understanding  C/C  as  a 

total  process.  I might  risk  a physical  ccnpariosn  to  Boyle's 
I Law.  I find  us  in  the  stage  before  statistical  mechanics  vden 

scientists  sought  to  trace  Avagadro's  nunber  of  molecules  in  a 
I rocm  with  Newton's  equations. . .all  6.02  • 10^^  of  than.  Even- 

tually we  learned 

I PV  = nRt 

^ was  as  instructive  as  Newton's  laws  in  dealing  with  ensanbles. 

This  seems  to  me  the  next  step  in  C/C.  If  I had  to  sun  up  the 
I need  for  M3E  that  sanantically  represented  these  ideas,  it  would 

be  "plasticity. " 

Thank  you  for  your  attention  and  interest. 
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CDOSING  REMARKS 


by  SETH  BONDER 

V^cXoK  Re-icaA-ch,  J ncoApoAotcd 


My  cxrrments  as  a critique  of  the  workshop  have  been  formu- 
lated with  respect  to  the  objectives  of  the  ifceting,  which  can  be 
stated  as: 

observe  the  user  cottmand/ control  requiratents  and  ongoing 
research  activities,  to  ascertain  where  the  research  offices 
should  encourage  research  that  will  be  relevant  to  improving 

cperations  and/or  planning. 

During  this  meeting  we  have  had  broad  and  intermingled  discussions 
of  many  facets  of  including: 

(1)  operations  and  related  problans, 

(2)  planning  problans  for  C^, 

(3)  decision  aids  and  related  research  to  add  cperations, 

I and 

(4)  sane  theoretical  research  activities  as  candidate 
thoughts  for  use  in  analysis  of  operations. 

3 

The  C operational  and  planning  problems  were  discussed  in  terms 
' of  various  systems,  procedures,  organizations,  and  training.  I 

would  like  to  say  that  I have  overlayed  all  of  this  information 
to: 

(1)  indicate  the  specific  nature  of  the  many  operational 
and  planning  problans, 

(2)  indicate  where  existing  theoretical  results  can  be  used 
to  solve  sane  of  these  problans,  and 

(3)  point  to  areas  where  additional  research  efforts  would 
be  useful  in  addressing  conrand  and  control  problans. 

I would  like  to  say  this — but  can't  since  I have  not  done  so. 
Instead,  I have  seme  general  and  specific  observations,  sane  of 
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which  can  be  interpreted  as  recatmendations,  which  I hope  will  be 
useful  to  the  research  offices  sponsoring  this  workshop.  In 
developing  these  coninents,  I have  specifically  kept  in  mird  the 
tactical  C*  problems  of  the  combat  comiander  fron  the  theater  down 
to  the  battalion  level  and  related  Air  Force  conmand/control  prob- 
lems, which  I believe  to  be  the  principle  subject  matter  of  the 
syiiposivin  rather  than  some  of  the  strategic  coimand/control  prob- 
lems addressed  a few  of  the  speakers. 

2 

/.O  Stiuctuie  0^  Tac-ttcai  C P^obtemi.  During  the  course  of  this 
workshop  we  had  a number  of  users  (e.g. , General  Vfelch,  General 
Creech,  Admiral  Kinnear,  Admiral  Engen,  Mr.  Robinson,  etc.)  dis- 
cuss many  operational  £UTd  planning  prctolems.  A saiipling  of 
these  problems  is  given  below. 

Operational  Problems 

o How  can  we  ensure  that  operational  decision  makers  continue 
to  pursue  a number  cf  hypotheses  regarding  enany  inten- 
tions, rather  than  focusing  in  on  a single  one  too  early? 
(Historical  examples  abound  where  the  enany  has  explicitly 
tried  to  reinforce  a single  false  hypothesis.) 

o How  can  the  success  of  an  operational  strike  be  deter- 
mined? 

o Hew  can  the  opetational  carmander  ascertain  the  status  of 
the  battlefield? 

o How  can  decision  making  of  operational  carmanders  be 
iitproved? 

o Hew  can  a crisis  in  the  making  be  detected? 

o What  are  appropriate  courses  of  action  to  take  to  reduce 
crisis  situations? 

o When  is  it  appropriate  to  use  the  full  camiand/control 
hierarchical  net  in  a crisis  situation,  rather  than 
direct  linking  to  the  NCA  as  has  been  the  case  in  a 
number  of  recent  crisis  situations? 


P 


o 


3 

What  is  an  appropriate  manner  to  operate  a C net  that  is 
partially  attritted  or  disrupted? 

o What  are  appropriate  electronic  warfare  tactics  to  disrupt 
the  ccniTiand/control  net?  When  should  it  be  applied?  Where 
should  it  be  applied,  against  whan,  and  for  what  duration? 
Planning  Problems 

o What  coimand/control  phenonena  should  be  included  in  meth- 
odology for  examining  the  cost-effectiveness  of  different 
comand/control  systems,  procedures,  and  organizations? 

o What  criteria  should  be  enployed  in  making  a cost-effect- 
iveness assessment  of  a conmand/oontrol  system  or  trade- 
offs among  elements  of  the  system? 

o Should  a syston  be  designed  with  distributed  or  central- 
ized data  files? 

o What  data  should  be  made  available  to  the  various  echelons 
of  coimand?  What  is  an  appropriate  organization  structure 
of  nets? 

o What  responsibilities  should  be  assigned  and  authorities 
delegated  to  various  cormand  levels  in  the  net? 

o Vlhat  procedure  should  be  employed  to  assume  reliable 
and  timely  responses  from  the  carmand/oontrol  system? 

o What  are  appropriate  training  procedures  for  cormanders? 
Although  the  users  and  sane  analysts  working  in  the  area  have  an 
understanding  of  parts  of  the  total  coimand/control  process  and 
related  problems,  we  did  not  have  presented  here  a useful  descrip- 

3 

tion  of  the  tactical  C process  that  could  be  used  to  overlay  the 
ongoing  research  activities.  It  is  not  at  all  clear  that  the  user 
knows  enought  about  this  process  to  enunciate  it  in  an  organized 
fashion  to  accorplish  the  objectives  of  this  workshop.  The  pro- 
cess is  very  coiplex  and  has  many  interactions  within  the  pro- 
cess and  between  the  and  other  processes  in  lauige  scale  cam- 
paigns. I think  it  would  be  fair  to  say  that  we  do  not  have  a 
military  science  of  carmand/oontrol  processes.  If  the  research 
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offices  are  serious  about  the  objectives  of  this  workshop  then  I 
vrould  recaimend  that  a paradigm  of  the  process  be  developed 
that  can  be  used  to  carpare  or  checklist  the  operational  and 
planning  problem  areas  {systems,  organizations,  procedures,  etc.) 
against  the  ongoing  applied  £md  theoretical  research.  I am  con- 
fident that  many  such  paradigms  can  be  developed  for  the  intended 
purpose.  It  seems  reasonable  to  expect  that  the  structure  would 
be  developed  by  a snail  combined  user-analyst  team  or  a small 
groip  of  knowledgable  analysts  having  ready  access  to  appropriate 
users. 

Research  Activities 

Although  theoretical  and  afplied  research  efforts  have  been 
presented  in  a number  of  diverse  areas,  it  is  clear  that  they  are 
disjoint  and  that  the  objectives  of  this  workshop  have  not,  and 
a priori,  could  not  have  been  accomplished.  I believe  this  state- 
ment to  be  true  for  a number  of  reasons; 

o As  noted  above,  no  organized  way  of  looking  at  the 
problem  areas  was  presented  at  this  workshop. 

o The  research  efforts  presented  at  the  workshop  were  seme- 
\4iat  disjoint  and  a structure  for  organizing  ongoing 
research  activities  in  a usefid  manner  was  not  presented. 

o Many  relevant  ongoing  research  efforts  were  not  presented. 

o It  was  clear  that  no  conmanicaticxi/language  mechanism 
existed  betv«en  theoretical  researchers  and  users  (I 
believe  General  Creech  made  a similar  observation) . 

It  seems  clear  to  me  that  a decoder  is  necessary  to  translate 
theoretical  results  (and  activities)  of  the  researcher  and  the 
requirements  of  the  user  into  a catmon  (probably  analytic)  langu- 
age and  then  a match  ii.g  of  the  research  results  and  user  require- 
ments be  made.  Accordingly,  I would  recomend  that  the  research 
offices  conduct  an  analysis  of  the  research  efforts  underway 
(categorize  them,  estimate  the  state  of  tlie  art,  etc.)  and  that 
these  be  matched  with  the  problan  areas  to  determine  vhere 
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matchings  existr  where  research  is  needed,  and  priorities  on  these 
research  needs.  I hasten  to  add  that  the  matching  of  theoretical 
research  to  user  requiranents  is  not  a siirple  overlaying  but 
rather  a creative  translation  of  abstract  results  and  activities 
into  areas  where  it  can  be  usefully  applied.  Such  an  activity 
must  be  performed  by  persons  knowledgable  in  both  theoretical 

language  and  content  and  various  aspects  of  the  C process. 

2 

2.0  CuAAent  Ope.'uitLonaZ  C Problem.  There  exists  sane  current 

3 

and  very  important  C operational  prcfclems  in  Europe.  Classifi- 
cation prohibits  discussion  of  these  at  any  length  in  this  un- 
classified workshop.  However,  sane  of  these  were  suggested  by 
General  Creech  regarding  the  lack  of  basics  of  cotmand/control  in 
Europe  and  the  vulnerability  of  the  C^  systan.  Although  I know 
the  problems  cannot  be  solved  by  study  alone,  I think  an  intellec- 
tual examination  of  them  by  sons  of  the  bright  minds  represented 
in  academia  (analogous  to  the  strategic  studies  conducted  in  the 
1950 ’s)  would  be  useful.  Perhaps  the  research  offices  could  make 
sane  of  this  talent  available  directly  to  study  organizations  (e.g.. 
Air  Force  Studies  and  Analysis)  or  through  working  seminars  to 
address  sane  of  these  operational  problems  specifically. 

3.0  PeeiAion  Aicto/Pe-ciAioK  MakeM.  Yesterday  we  heard  about  sane 
significant  research  and  design  efforts  to  assist  the  C^  decision 
maker  and  to  determine  hew  to  design  systems  that  he  can  and  will 
use  in  an  operational  setting.  Clearly,  this  is  a correct  objec- 
tive since  the  cctrmanders  wall  need  assistance  (he  will  be  under 
an  informaticxi  overload,  cembat  activities  will  be  fast  moving  and 
cotplex,  etc.)  and  a systan  should  be  desigred  so  they  can  be  used 
and  are  useful.  It  is  equally  clear  that  we,  the  analytical  con- 
munity,  can  provide  aids  that  wall  be  useful  in  a number  of  dif- 
ferent ways.  It  seons  to  me  that  we  can  group  decision  aids  into 
three  decision  classes: 

(1)  Inferential  processing  aids  wAiich  can  draw  useful  infe- 
rences from  a large  amount  of  detailed  data.  Pattern 
recognition  techniques  are  an  obvious  exanple  of  this 
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type  of  aid,  as  are  aids  which  point  out  negative  ] 

inferences  (e.g. , an  indicaticsi  of  when  detections  of  | 

two  tank  coipanies  at  different  points  in  time  could 
not,  because  of  physical  consideraticxis,  be  construed 
as  being  the  same  tank  cotpany) . 

2)  Conputational  aids  to  provide  the  coranander  with  effort, 
effectiveness,  and  risk  inforrotion  associated  with 
different  courses'  of  action.  Exairples  of  this  might 

include  the  revised  PERT  analysis  of  Professor  Hartley,  ] 

vhich  might  be  used  operationally  to  generate  the  dis-  ] 

tribution  of  the  time  for  a large  unit  to  move  from  | 

point  A to  point  B through  a large  transportation  net-  j 

work.  The  ccmbat  result  implications  of  different  al-  ! 

ternative  force  deployments  is  another  exairple  of  this 
type  of  aid. 

<3)  Decision  aids  which  autcmatically  made  good  or  "optimal" 
decisions  in  areas  that  require  a very  rapid  response 

and  are  in  a sense  "not  dramatically  critical."  < 

I personally  believe  there  is  a great  need  for,  and  that  atphasis 
should  be  placed  on,  the  development  of  aids  in  the  first  two 
categories  with  less  enphasis  on  actual  decision  aids.  Seme  of 
the  latter  should  be  developed  in  areas  in  which  those  decisions 
are  already  (or  are  in  the  process  of  being)  automated,  such  as 
the  allocation  of  field  artillery  batteries  to  targets  in  a fire 
direction  center  via  the  use  of  TACFIRE. 

Presentations  on  the  topic  of  decision  aids  and  decision 
makers  at  this  workshop  might  be  classified  into  two  categories. 

The  first  of  these  is  research  intended  to  develop  an  understand- 
ing of  the  decision  making  process.  Exairples  of  this  type  of 
research  activity  are  the  works  presented  by  Dr.  itoirick  from 
Honeywell  which  tries  to  ascertain  how  conmanders  nake  decisions 
or  the  different  styles  of  decision  making  and  by  Bob  Andrews  of 
ARI  which  tries  to  ascertain  what  information  cdmanders  do  in 
fact  use.  I believe  the  intent  of  these  types  of  research  is  to 


557 


leam  how  to  design  decision  aids  and  systems  that  will  be  useful 
to  ccmanders.  The  second  category  described  in  this  workshop 
regards  the  use  of  decisicxi  aids  (fron  ray  earlier  definition)  to 
assist  the  decisicxi  maker  directly  in  making  decisions  or  to  train 
him  in  making  better  decisions.  Efforts  in  these  areas  were 
described  by  Dr.  Kelly  of  DDI  and  Dr.  Weltman  of  Perceptronics, 
Inc. 

Although  both  of  these  areas  have  sane  recognized  value, ^ I 
don't  believe  they  should  be  the  principal  approach  p>ursued  to 
inprove  the  ccmtanders  decision  making  capability  or  to  develop 
aids  for  the  decision  maker.  I have  a number  of  concerns  regard- 
ing the  first  area  of  research  (i.e. , understanding  the  decision 
making  process) . I believe  it  is  very  difficult  if  not  impossible 
to  determine  (infer)  Ikdw  decision  makers  make  decisions  and  what 
information  they  will  use  in  a particular  situation.  Secondly,  it 
is  not  at  all  clear  to  me  that  we  sfiould  be  designing  systems  and 
aids  based  on  data  from  cctrmanders  who  have  not  had  adequate 
experience  or  training  in  the  use  of  such  systans.  For  many 
reasons,  I have  concerns  about  autonated  "decision  aids"  for 
crisis  nanaganent  situations  that  are  based  on  expected  utility 
conc^ts  or  the  training  of  decision  makers  to  maximize  the 
expected  utility  (or  for  that  matter,  the  use  of  ar.y  other  single 
model  of  the  decision  maker) . 

As  previously  noted,  these  research  efforts  do 

(a)  train  decision  makers  via  the  use  of  a "decisicxi  maker 
model , " 

(b)  develop  an  understanding  of  the  decision  making  process, 
and 

(c)  develop  decision  aids,  pier  the  talks  presented  at  this 
symposium,  which  have  seme  value  in  the  overall  train- 
ing of  decision  makers  and  the  design  of  inferential, 

^ Data  for  comtander  selection,  development  of  graphics  and 
appropriate  interactive  techniques,  etc. 


canputational , and  decision  aids. 

However,  I believe  (and  1 tMnk  past  research  results  tend  to 
support  the  hypothesis)  that  these  objectives  can  be  obtained  by 
piursuing  a very  different  approach — that  of  training  decision 
makers  via  the  concept  of  "guided  ejqjerience. " That  is,  we  should 
train  decision  makero  in  the  decision  making  activity  by  letting 
than  practice  decision  making  in  simulated  contexts  with  appro- 
priate feedback,  letting  them  observe  the  results  and  associated 
risks  that  are  obtained  as  a function  of  tteir  decisions. 

Although  I have  not  had  the  time  to  think  through  the  ramifica- 
tions of  this  approach  conpletely,  it  is  clear  that  if  offers  a 
number  of  benefits,  soie  of  vdiich  are  noted  belov^: 

o Ccmnanders  will  learn  to  make  "good"  decisions  by  devel- 
oping a better  understarding  of  the  ccnplex  processes 
they  are  supposed  to  ccntrol.  It  is  well  recognized  that 
a not  insignificant  number  of  ccmnanders  do  not  urder- 
stand  the  iitpact  of  modem  technology  ard  how  it  will  or 
should  influence  the  ccmmand  function.  In  this  context, 
ccmnanders  will  learn  about  the  ramifications  (effective- 
ness, risks,  etc.)  of  different  decision  choices;  and 
this  )cnowledge  can  be  used  in  a personal  nenner  \«4ien 
actual  operational  situations  occur,  rather  than  forcing 
decision  practice  into  a particular  mold  of  a stylized 
decision  maker. 

o Training  of  ccmnanders  via  guided  experience  in  simulated 
contexts  can  provide  an  appropriate  experimental  setting 
to  determine  diere,  in  fact,  aids  will  loe  useful  to  per- 
spective ccmnanders. 

O Assuming  adequate  icnowledge  is  available,  through  appro- 
priate curricular  design  the  guided  experience  approach 
can  iae  used  to  show  perspective  ccmnanders  how  to  use 
information  and  caiputerized  aids  appropriately.  Al- 
though I am  not  suggesting  a Pavlov  conditioning,  in  a 
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sense  this  approach  will  educate  those  vho  are  unaware 
such  aids  can  be  useful  and  provide  appropriate  training 
with  than. 

o This  mechanism  of  simulated  decision  making  training  can 
also  provide  an  appropriate  observation  vehicle  to  deter- 
mine the  kinds  and  structure  of  decision  making  logic  to 
incorporate  into  planning  methods;  i.e.,  large  scale  cam- 
paign models.  The  tendency  today  is  to  doctrine  doctrine 
as  stipulated  in  apprcpriate  field  manuals  (ratlier  than 
decision  making  behavior  vihich  is  more  likely  to  occur) 
or  optimal  decision  making  behavior  based  on  the  analyst's 
view  of  the  world. 

o Finally,  such  a guided  experience  training  vehicle  could 
serve  an  analysis  function  in  that  it  will  provide  insight 
into  the  development  of  good  tactics,  resource  allocations, 
cannand  behavior,  etc. 

A number  of  systems  have  been  developed  recently  that  might  be 
used  for  this  purpose  in  selected  areas.  These  include  the  Marine 
Corps  Tactical  Exercise  Simulator  and  Evaluator  (TESE)  and  the 
Army's  Cotibined  Arms  Tactical  Training  System  (CATTS) . Neither  of 
these  systems  have  been  used  in  the  mode  suggested  above,  but 
rather  as  procedural  training  vehicles  to  large  sized  cannand/ 
control  staffs.  I believe  they  can  simultaneously  be  used  for 
individual  decision  making  training  per  the  approach  above,  al- 
though a number  of  research  questions  still  need  to  be  addressed 
to  ' earn  how  to  iitplement  this  approach  sufficiently  and  effective- 
ly. These  questions  involve  appropriate  curriculum  design  to 
ccrmunicate  and  identify  certain  principals,  the  means  of  appro- 
priately presenting  information  for  learning  (real,  extended,  or 
corpressed  time;  error  free  or  real  information,  etc.),  the 
amour t of  "guided  experience"  required,  etc. 

4.0  P^ziented  TheoAi/.  At  tiiis  workshop  a nuitter  of  theoretical 
research  activities  were  presented  by  seme  well  loiown  aind  extranely 
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capable  researchers  (Professors  Hartley,  Saaty,  Gtpta,  etc.).  As 
a former  full  time  acaciemic  and  new  practicing  analyst,  I am  sure 
I could  identify  sane  use  (albeit  small)  of  the  tlieoretical  efforts 
that  would  be  related  to  conmand/control.  However,  I believe  nuch 
of  the  theoretical  efforts  presented  here  miss  the  real  target  with 
re^sect  bo  conmand/control  problems.  For  exanple,  as  I previously 
noted,  the  work  of  Professor  Hartley  could  be  used  as  a caiputa- 
tional  aid  to  assist  the  coimander  in  a mobility  problem.  However, 
it  would  be  significantly  more  valuable  fran  the  ccmarri/control 
point  of  view  to  develop  methods  to  assist  in  the  design  of  "good" 
caimand/oontrol  networks  and  hierarchies  ard  to  determine  how  to 
operate  than  when  the  net  is  in  a partially  attritted  or  damaged 
state.  My  experience  as  a practitioner  suggests  that  many  of  the 
interesting  and  irrportant  theoretical  problems  arise  from  the 
practice  and  are  recognized  by  the  practitioner.  Although  I 
understand  the  value  aid  inportance  of  sipporting  theoretical 
research  in  universities,  the  research  offices  should  recognize 
that  many  practitioners  are  capable  of  working  theoretical  research 
problans,  are  interested  in  doing  so,  and  can  identify  arpag  vrf>gre 
critical  needs  exist.  Usually  the  problem-oriented  support  for 
practitioners  precludes  any  significant  amount  of  abstract  theore- 
tical research.  At  a minimum,  the  research  offices  should  develop 
a mechanian  by  which  university  researchers  can  interchange  with 
appropriate  practitioners  on  a frequent  and  regular  basis. 

I have  a number  of  minor  observations,  however,  it  seans 
inappropriate  to  use  any  more  of  this  valuable  weekend  time  to 
present  than.  For  similar  reasons,  I have  not  taken  the  time  to 
highlight  many  of  the  valuable  facets  of  this  syitposiurn/workshcp>. 

In  conclusion  we  should  recognize,  as  I have  previously  noted, 
that  the  objectives  of  the  workshop  have  not,  and,  a priori,  could 
not  be  accoiplished.  It  has,  hewrever,  served  as  an  inportant 
vehicle  for  exchange  of  ideas  and  a means  of  verifying  that,  in 
fact,  the  problem  which  motivated  the  workshop  does  exist. 
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Hartley:  this  nay  be  a very  naive  question.  I think  that  I 
should  address  this  to  Dr.  Bracken.  He  talked  about  the  appli- 
cations of  game  theory.  I am  a little  bit  puzzled  about  the 
application  of  gene  theory  in  an  uncleissified  sense  because  this 
theory  makes  an  assutption  about  an  adversary  behavior.  If  you 
reveal  what  kind  of  game  theoretical  model  you  are  using,  it  is 
very  sinple  for  an  adversary  to  behave  in  actually  the  opposite 
way  than  that  theory  would  assume  him  to  behave.  There  nust  be 
sonething  that  does  not  give  away  the  third  base  coach  signals. 

Brackoi:  I have  an  answer  to  that.  If  one  solves  a game  theo- 
retical problem  and  one  has  full  knowledge,  regardless  of  what 
the  cpponet  chooses,  one  is  guaranteed  to  get  at  least  that  pay- 
off. Now  if  one's  opponent  has  full  knowledge  then  he  will 
indeed  ohoose  the  optimal  strategy.  In  any  game  of  theoretical 
context,  one  is  guaranteed  at  least  the  bcQance.  General  Kantor 
has  pushed  this  concept  pretty  hard,  toc^  it  over  from  Berkowitz 
and  Dresher  basically  in  the  late  60' s,  termed  the  strategies 
mutua-ly  enforceable  which  I think  is  a good  grot^j  work.  You 
can  enforce  any  kind  of  strategy  pick  and  if  the  other  person 
doesn't  pick  his  optiiral  strategy,  he  does  worse,  necessarily. 

Dockery:  We  ran  a class  of  siirulations.  The  wily  one  that  we 
locked  up  and  placed  the  corputer  on  were  things  like  nuclear 
strike  vhich  are  very  precise  targets,  very  precise  roles,  very 
context  dependent.  The  rest  of  vhat  we  run,  depending  on  the 
data,  nay  or  may  not  be  classified  and  then  not  very  hi^ly 
because  we  cire  essaitially  using  information  available  on  our 
side  in  the  open  literature  asking  what  can  happen  to  narrow 
the  universe  of  possibilities.  What  actually  will  happen  depends 
on  the  ocntrol  and  ocmand  that  will  be  exercised  at  any  given 
time. 

Sovereign:  It  seems  to  me  that  there  is  an  advantage  in  the 
game  theory  context  in  that  you  do  find  the  boundciries  cind  set 
exanples.  You  have  certain  boundaries  at  oertain  times,  for  j 
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exaitple,  vrtien  information  is  detrimental,  in  the  saise  that  you  j 

have  a mixed  strategy.  What  you  would  like  to  do  as  a scientist  : 

is  design  a military  force  theory  vdiere  you  had  a set  of  pure 
strategies  so  you  don't  have  this  worry  about  the  information 

problems  that  lead  to  mixed  strategies.  I think  tlere  are  cer-  , 

tain  principles  that  a military  leader  at  the  top  of  the  ccmand 

and  ccxitrol  system  is  going  to  have  to  learn  through  exanples 

like  this  and  put  them  into  a context  of  history.  I think  that 

type  of  course  is  vdiat  is  needed  in  the  war  college  and  maybe 

in  post  graduate  schools  and  other  schools. 

Coatte;  I do  vrant  to  point  out  the  difference  between  the  pro- 
fessional military  education  institutions,  the  war  colleges,  and 
the  graduate  education  institutions,  the  Air  Force  Institution, 
the  Naval  post  graduate  school,  in  terms  of  role  and  rank  of 
officers.  I think  that  you  said  that  top  level  people  will  quite 
a bit  later  after  going  through  something  like  this,  go  to  the 
college. 

J.  Hicirpson;  I wiild  like  an  estimate  of  the  percentage  of  the 
dollars  spent  fcy  D(X)  cxi  large  scale  war  games  in  a year  or  so 
vhidi  (1)  have  ccnmand  capabilities  and  (2)  have  besn  validated? 

Do  ve  have  capabilities  like  Andrews  sv^ested?  Secondly,  v*iat 
percentage  of  military  resources  have  been  used  for  war  games 
which  have  actually  been  validated  using  historical  data? 

Dockery:  It  is  easier  to  answer  the  second  question  first.  As 
you  know,  it  has  really  been  tested  in  the  scientific  sense  and 
verifies  actual  data.  Hiis  is  a second  model,  forgetting  those 
that  are  interactive.  There  have  been  sane  that  hatve  been  tested 
against  ^ecific  air  defense  models.  Some  of  the  work  that  has 
been  done  at  Rand  came  under  the  samll  little  oitry  model.  The 
Vietnamese  time  situation  tested  out  purely  wrong  I think.  The 
large  scale,  division  and  above,  the  AEFD  people,  tented  the 
ocrputer,  have  done  sane  work.  They  are  not  testing  their  models 
tut  are  just  trying  to  draw  inferences  from  sane  statisticcil 
information.  More  importantly,  since  1973  we  can  test  the  nodels 
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becatise  the  data  has  be«i  collected.  There  is  a cotpendiian  of 
data  on  the  whole  set  of  mideast  canpaign.  It  is  sitting  there 
and  there  is  this  opportunity  to  test  at  least  one,  two  or  three 
agciinst  than.  There  is  not  sufficient  data  in  either  of  those 
cases  to  do  that  test  because  all  the  models  do  require  seme  in- 
formaticn  that  we  do  not  even  have. 

Welch:  Most  of  the  decision  level  models  at  least  in  the  past 
will  show  very  shaap  well  moved  capeibilities  based  cxi  force  ratio. 
If  you  plot  propensity  to  win  versus  force  ratio,  it  will  shew  a 
very  sharp  curve.  Historical  data  refutes  that  almost  exclusively. 
It  says  that  vhen  you  are  down  3 to  1 you  still  have  a probability 
of  3 to  1 of  losing.  In  that  sense  they  have  been  tested.  In  tty 
view  my  own  conclusions  from  looking  at  those  models  is  that  by 
and  large  they  do  not  include  decision  processes  vhich  acxxsunt 
for  that  great  disparity  in  test  results.  I think  that  because 
of  this  cijvious  randan  real  data  that  indeed  people  did  not  go 
further. 

Bonder:  I know  of  two  tests  actually.  Cne  was  done  by  STAG  the 
predecessor  of  CAA  (Concepts  Analysis  Agency)  using  ATIAS  with 
the  Korean  War  data.  Atlas  results  did  noatch  the  Korean  War 
data.  Another  was  done  by  the  joint  war  games  agencies  to  an 
Arab-Israeli  War  using  Atlas  again  and  it  did  not  matche  the 
Arab-Israeli  war  data.  It  is  a corputer  model  where  the  outputs 
are  based  on  the  force  ratios  and  in  the  case  of  Korea  that  pro- 
vided a good  ^proximation  in  the  case  of  the  Arab-Israeli  War 
it  was  not. 

Question:  The  programs  that  don't  work  are  those  in  vAiich 
rtaneuver  and  such  things  are  strong  elements  of  the  attack.  The 
best  one  we  can  simulate  would  be  trench  warfare  because  of  a 
p»rp)etual  stalemate.  Those  things  in  idiich  maneuver  is  an  element 
are  done  less  well,  less  predictably  and  those  which  require  con- 
trol are  just  now  beginning  to  be  addressed. 

Bonder:  Your  caiments  relate  to  the  inpact  of  catmand  and  con- 
trol. I'm  not  sure  if  that  is  the  only  variable  factor  which 
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makes  it  wcark  better.  It  is  true  that  the  connand  and  cxmtrol 
input  changed  some  of  the  cotmand  behavior  and  the  results  changed 
dramatically.  I have  seen  another  division  study  v^iere  we  got 
great  divisional  burdens  after  we  used  your  outcast  studies  and 
sane  others  where  ve  just  characterized  the  decision  behavior  to 
observe  vdiat  would  haj^jen.  It  is  a tremendous  inpact.  That  pro- 
bably answers  your  first  question. 

The  second  question  about  how  many  are  interactive,  how  you 
have  war  games  with  many  players  involved.  Ihere  are  a vhole 
bunch  of  those  vhich  exist.  The  problem  with  them  is,  Jim,  is 
that  they  just  take  too  damn  long  to  use.  We  are  talking  6 
months  sometimes,  5-10  hours  or  more  and  you  don't  get  a para- 
metric analysis.  What  you  get  is  a certain  behavior  of  that 
game  and  it  takes  6 months. 

J.  Thotpson:  I want  to  get  something  out  of  it.  If  we  are  not 
in  the  practice  validating  these  models  with  historical  data,  I 
would  at  least  like  for  them  to  be  used  in  training. 

Welch;  I'll  tell  you  what  they  are  used  for  and  that  is  equip- 
ment selection. 

Bracken;  The  internal  logic  of  the  gate  is  presunably  defensible 
and  they  serve  as  a language  about  vhich  to  disojss  trade-offs 
among  weapons  systems.  In  fact,  they  are  the  only  language  to 
talke  about  weapons  systems  with.  Therefore,  vrfienever  there  is 
an  cuialytical  stuity  of  the  impact  of  the  deciscn  process  it  mast 
be  made  in  a language  which  is  open  and  explicit  and  understood 
by  all  parties.  New,  that  is  not  to  say  that  the  po^le  vho 
make  the  decisions  are  necessarily  bound  the  recessive  model, 
but  it  is  the  only  consistent  language  that  simulates  interaction 
and  takes  everything  into  account  and  is  cin  input  into  the  deci- 
sion process. 

Qaesticn;  Air  defense  weapons,  o.k.  In  an  equipment  selection 
procedure,  we  look  and  make  relative  cenparisons  to  the  absolute 
question  is  brains.  It  involves  bringing  in  the  threat,  the 
Soviet  Pact  edr  fleet  aginst  the  Air  defense  of  Western  Europe. 


In  fact,  that  is  an  equipnent  selection  process.  There  are  sim- 
plifications as  to  the  number  of  levels,  but  the  veapcsis  are 
turned  loose.  The  game  is  played.  Two  runs  cure  played  a day. 

The  officers  go  off  into  a oomer  and  reconfigure  the  assets. 

Hfe  played  a similar  gams  and  they  came  back  on  day  2,  reoongigure 
the  assets  ctfter  that.  So  ve  speed  the  ting  tp.  What  we  are 
using  it  for  is  equipment  selection  and  essentially  it  is  the 
only  game  in  town  because  the  ccirbinatorics  are  just  cut  of  sight. 
Bender:  Jim,  let  me  oomnent.  Clearly,  one  can  raise  issues  about 
degree  erf  validity  and  degree  of  belief  of  assurptiens,  but  as 
Jerry  pointed  out,  it  is  the  language  in  vdiich  you  raise  ques- 
tions. You  can  say,  I don't  believe  that  assurpticn.  At  least 
you  hctve  something  that  you  can  agree  to  disagree  about.  Some 
of  the  basic  policies  are  modelled  reasonably  well,  maybe  not 
verified  on  an  unambiguous  scale.  It  give  you  something  to 
develop  some  insight  with  or  at  least  get  a point  of  discussion, 
but  if  you  have  semeboyd  with  a closed  mind  and  somebody  drive 
throi^  and  say  I see  it  and  it's  green.  The  discussion  itust 
stop.  This  is  because  there  is  nothing  to  talk  about.  This 
gives  you  something  to  question.  I don't  believe  that  assurption. 
I don't  believe  that  data,  let's  hear  hew  you  came  ip  of  that 
data.  Then  let's  come  ip  with  some  new  assunpticxi.  You  can  do 
that.  I don't  see  ciny  significant  alternative  to  that  problem. 

J.  Thenpson:  The  nain  idea  behind  that,  let  me  say,  that  we  have 
some -ling  incredibly  more  exp)ensive,  incredibly  more  cciiplex  with 
no  reeil  data  validation  b^ind  it. 

Bonder:  We  have  cenputer  assisted  vrar  games  vhich  a lot  of  the 
dice  throwing  and  the  isplicaticns  of  the  decision  are  dunped 
into  the  oenputer.  They  irake  the  decision  before  the  course  is 
treated,  often,  and  does  an  hour  or  range.  It  gives  you  the 
results.  You  go  up  into  a rxxm  and  readjust  it.  You  do  the 
ocnplete  iranual  war  game.  I am  saying  that  when  the  cciiputer  can 
do  its  job  best  and  the  major  work,  the  setting  of  the  track,  the 
changing  strategy  to  meet  the  effort  that  you  have  left  off  line. 
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Then  the  thing  is  re-sutmitted. 

Welch;  When  all  things  are  working  in  a historical  situation, 
you  have  to  be  able  to  diplicate  with  considerable  accuracy. 

A great  many  himan  factors,  psychological  factors,  and  skilled 
ocrnnanders  are  involved.  Do  you  have  that  ability? 

Bonder;  That  would  be  as  catplicated  and  would  be  a major 
undertaking  vrtiich  would  cnly  validate  that  particular  model  and 
your  technique.  I would  not  then  trust  it  for  a task  worker 
anywhere  else,  but  then  I understand  how  to  build  such  a models 
and  that  would  be  it. 

J.  Thompson;  I can't  agree  with  that.  I don't  see  why  you  have 
to  get  a very  good  data  about  v^at  is  going  on  in  the  minds  of 
the  exposing  generals  in  order  to  play  your  game. 

Welch;  Well,  let  me  say  what  we  did  in  prc±)abilitY  may  be 
interesting  to  you.  I learned  that  there  was  a very  siiiple 
method  for  large  units  when  they  feel  surrounded,  surrendered 
even  though  they  don't  have  to.  That  seemed  like  a very  useful 
thing  to  notice,  and  in  fact,  lead  to  some  substantial  require- 
ments. It  also  lead  to  quite  a number  of  other  things  v*iich  is  to 
worry  like  hell  about  these  fancy  sensors  that  might  determine 
what  was  the  efficacy  of  that  threat  surrounding  us.  So  ir 
seemed  to  me  that  those  were  at  least  two  very  straightforward 
lessons  to  lecun. 

Question;  No,  I wouldn't  say  we  haven't  validated  sine  we  dcxi't 
knew  viiere  ws  are  going  to  a degree.  Ihe  simulations  we're 
running  went  for  4 hours  and  we  have  a ocmplete  trace  of  every 
simple  event  generated  stochastically  by  that.  We  then  changed 
the  statistical  analysis.  We  have  them  examined  by  officers. 

We  cCTtpare  the  individual  operation  with  the  test  data.  And 
that's  the  best  that  we've  got.  We've  got  absolute  fine  grain 
analysis.  That  the  best  we've  got. 

Question;  Weapons  selection  ax&  not  made  on  the  basis  of  your 
estimation  of  the  cleverness  of  the  pecple.  The  weapons  selec- 
tion is  made  on  your  estimate  of  the  physiced  svperiority  of  the 
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device  you  eire  vending. 

Question;  One  of  the  comnanders  decides  he  is  lost,  independent 
of  the  actual  situation.  One  might  make  a ccmarKi  and  control 
point  of  locking  at  some  of  those  battles,  they  can  find  out  v*iat 
infornaticn  led  to  that  conclusion. 
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